Menu
Examples
HTML
HTML5
CSS
CSS3
JavaScript
jQuery
AngularJS
Articles
Articles
Tech Articles
Blog
Interview Questions
Computer Science
Civil Engineering
Mechanical Engineering
ECE
EEE
QUIZ (or) MCQ
S/W (or) Computer Science
Civil Engineering
Mechanical Engineering
ECE
EEE
Programs
C Language
C++ (or) CPP
Java
Python
PHP
Competitive Exams
Current Affairs MCQ
Monthly Current Affairs MCQ
Today GK
General Knowledge
Verbal Ability
Mental Ability
UPSC
UPSC Previous Questions
UPSC 2022 Prelims Questions
UPSC 2021 Questions
UPSC 2020 Questions
UPSC 2019 Questions
S/W Tutorials
References
Practice Templates
PHP Projects
Bootstrap 3 Plugins
Bootstrap 4 Plugins
Articles
Articles
Tech Articles
Blog
Marketing Management
School Mathematics
Quadratic Equations
Prime Numbers
Factorial Numbers
Fibonacci Numbers
Code Editor
IPC Sections
SEO - Interview Questions
Home
Interview Questions
SEO
What is robots.txt?
robots.txt is a text file that instructs web robots (search engine robots) about how to crawl pages on their website. It is used to manage crawler traffic to the website.
More Technologies Interview Questions
Machine Learning
Artificial Intelligence
IOT QUIZ
Blockchain
Deep Learning
Data Science
LLM
ChatGPT
Metaverse
DevOps
Cyber Security
Ethical Hacking
HyperAutomation
Microsoft Azure
AWS
Cloud Computing
Quantum Computing
Edge Computing
Cognitive Computing
RPA
5G Network
Checkpoint
Neural Networks
Virtual Reality
Augmented Reality
Full Stack Developer
Web Services
Angular
Node JS
React JS
C-Language
CPP (or) C++
More
Advertisement
