봇들이 너무 많이 들어와서 여기저기 찾아보며 정리하였습니다.
너무 미세팁이라 망설이다 올려봅니다.
저처럼 서버 모르는 초초보자분들 붙여 넣기만 하시면 됩니다.
이렇게 하니 봇들의 90%는 줄은듯 하네요.
혹시 더 좋은 방법이 있으면 댓글로 조언 부탁드립니다.


robots.txt

User-agent: AdsBot-Naver
Crawl-delay: 30

User-agent: AhrefsBot
Disallow: /

User-agent: AlphaBot
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: archive.org_bot
Disallow: /

User-agent: BDCbot
Disallow: /

User-agent: bingbot
Crawl-delay: 1

User-agent: BusinessBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Dataprovider.com
Disallow: /

User-agent: Daum
Allow: /

User-agent: Daumoa
Allow: /

User-agent: DialogSearch.com Bot
Disallow: /

User-agent: Digincore crawler bot
Disallow: /

User-agent: DomainCrawler
Disallow: /

User-agent: DomainSigmaCrawler
Disallow: /

User-agent: DotBot
Disallow: /

User-agent: ezooms
Disallow: /

User-agent: facebookexternalhit
Allow: /

User-agent: Googlebot
Allow: /

User-agent: Googlebot-Image
Disallow: /

User-agent: Googlebot-Mobile
Allow: /

User-agent: GPTBot
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: kisaBot
Disallow: /

User-agent: LinkedInBot
Allow: /

User-agent: ltx71
Disallow: /

User-agent: Mail.RU_Bot
Disallow: /

User-agent: MauiBot
Disallow: /

User-agent: Mediapartners-Google
Allow: /

User-agent: MediavBot
Disallow: /

User-agent: MegaIndex.ru
Disallow: /

User-agent: memoryBot
Disallow: /

User-agent: mfibot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: msnbot
Disallow: /

User-agent: msnbot-media
Disallow: /

User-agent: NeumobBot
Disallow: /

User-agent: PageAnalyzer
Disallow: /

User-agent: PagesInventory
Disallow: /

User-agent: PiplBot
Disallow: /

User-agent: Plukkie
Disallow: /

User-agent: roboto
Disallow: /

User-agent: rogerbot
Disallow: /

User-agent: RSNBOT
Disallow: /

User-agent: SafeDNSBot
Disallow: /

User-agent: semanticbot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /

User-agent: sistrix
Disallow: /

User-agent: SMTBot
Disallow: /

User-agent: Sogou
Disallow: /

User-agent: SurveyBot
Disallow: /

User-agent: TurnitinBot
Disallow: /

User-agent: UXCrawlerBot
Disallow: /

User-agent: Wotbox
Disallow: /

User-agent: Yahoo-MMCrawler
Disallow: /

User-agent: Yandex
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: Yeti
Allow: /

User-agent: ZumBot
Allow: /



기본환경설정>접근차단 IP

100.28.+

100.29.+

104.250.+

138.91.+

17.+

18.+

184.72.+

184.73.+

185.191.171.+

20.+

217.182.+

23.+

3.+

34.+

44.+

47.82.+

50.16.+

51.255.+

52.+

54.+

57.141.14.+

74.7.+

98.82.+

98.83.+

98.84.+