Skip to content
Brian Cantoni
Software engineering leader and occasional side project hacker
  • Home
  • About
  • Contact

Category: Web

Using Robots.txt to Control Search Engines

2002-11-12 Brian Cantoni

While reviewing some of my referrer logs recently, I noticed a couple of hits to specific picture pages based on Google search results. I decided it was time to learn how to keep search engines away from certain parts of my site. Following are some things I learned along the way.

Continue Reading →

Posted in: Web

Post navigation

Page 36 of 36
← Previous 1 … 35 36

Follow

Projects

  • Engineering Tourist - Coming soon!
  • Tweetfave - RETIRED
  • Weather by Text - Request weather conditions by text messaging - RETIRED
  • Scooter Labs - More projects

Categories

  • Aerospace (10)
  • AI (3)
  • Books (6)
  • Career (13)
  • Cloud (5)
  • Data (3)
  • Fun (59)
  • Government (4)
  • Hardware (14)
  • IM (9)
  • Learn (2)
  • Mobile (52)
  • Money (6)
  • Other (29)
  • PDA (48)
  • Performance (2)
  • Pictures (12)
  • Podcasting (12)
  • Productivity (3)
  • Screencast (2)
  • Security (2)
  • Site (47)
  • Social (4)
  • Software (190)
  • Sports (65)
  • Tableau (1)
  • Tidy (2)
  • Tools (15)
  • Video (4)
  • Web (176)