Blog: SEO

Technical Search Events in Seattle and San Francisco

June 3, 2009

Just a quick post to mention a couple of places to get answers to all of your technical search-related questions!

First, check out my post on Search Engine Land on Google’s new ability to execute JavaScript onClick events and the continuing searchability issues with technologies such as AJAX and Flesh.

This afternoon (June 3rd) at the close of SMX Advanced in Seattle, Jane and Robot and Adobe/Global Strategies are hosting an after-hours meetup so SMX attendees can ask any questions that came up over the course of the conference. The meetup is open to anyone! You don’t need an SMX pass to attend, so if you’re in Seattle and have technical SEO questions, come on down! It’s in the Sound Conference room at Bell Harbor from 4:30 to 6:30pm. We’ll have the usual drinks and snacks and networking time as well!

Then on June 12th in San Francisco, Jane and Robot and Microsoft are hosting a Search Developer Summit. If you’re a web developer, this is a great opportunity to hear directly from other devs who have been there, as well as search engine reps, on best practices for building sites that can be easily found by search engines. there will be lots of case studies, discussion time, and Q&A with the experts. And both lunch and afternoon drinks and snacks are included for the amazingly low price of $49! (For a limited time! Act now! Representatives are standing by!). But seriously, space is limited to register now before we’re sold out.

And if you’re at SMX Advanced today, come by the SEO audit session or the mega session and say hi!

Developers Welcome at SMX Advanced!

May 8, 2009

What’s a key element to effective search engine optimization that leads to increased customer acquisition through search? In the immortal words of Steve Ballmer: developers (and also developers, developers, etc.).

SMX Advanced, the always-awesome advanced search marketing conference, is coming up in Seattle on June 2nd and 3rd. Last year, I programmed a developer day that brought developers and search marketers together around technical SEO issues. We continued the dive into web infrastructure issues at SMX West in February. This year, SMX Advanced features great advanced online marketing content and an all-new In House SEM Exchange, and some of you asked if this year included content for developers, since we aren’t doing a separate developer day.

I’m happy to report that we’ve just added a developer-focused session and events and have put together a recommend itinerary of the agenda to provide developers with a list of the sessions that will interest them the most.

So if you’re:

  • a developer who wants to add to your marketable skill set and learn more about building search-friendly web sites
  • an engineering entrepreneur who wants to make sure you are building your web application so that potential customers can easily find you for free
  • A developer in a large organization who wants to build search-friendly code into the development process
  • A search marketer who works closely with developers

Then you don’t want to miss this special itinerary at SMX Advanced. If you’re a search marketer planning to attend the conference, bring along your developers and come away from the conference with a shared understanding of how best to work together to build SEO into the entire marketing and development process.

I’m a developer? Why do I need to know about SEO? Isn’t that for marketing?

Search is the primary navigation method on the web, so if your site can’t be easily found in search engines, you’re losing substantial customer acquisition opportunities. A key element in being found in search engines is the site’s technical architecture. If you are a web developer, the ability to create search-friendly technical architecture is a valuable skillset. If you are launching a web startup, you want to attract as many customers as possible, and being easily found in search is a great way to do that for free.

What can I expect as a developer attending SMX Advanced?

The developer itinerary outlined below can give you the foundation you need to ensure your site’s technical implementation improves rather than hinders the ablity of potential customers to find you from searching.

We’ve added a special session and Q&A time just for developers, as well as provided a suggested path through the agenda with sessions that focus on technical implementation, diagnosing issues, and overall site architecture for optimal search engine crawling and indexing.

Remember, you’re free to attend any session you’d like and havefull access to all sessions and networking events. But the recommended path for developers is:

Day 1:

Jane and Robot Presents SEO Overview for Developers
This special session is intended to give developers an overview of how search engines work and the important element to consider for search engine optimization (SEO) when building web infrastructure. This introduction will set the stage for later sessions that will dive into the details of each technical element.

Learn about how search engines work, including discovery, crawling, extraction, indexing, ranking, and display. Find out about the most important technical elements for effective search acquisition. Topics include developing a crawlable infrastructure, building rich internet applications, URL rewriting, redirection, and canonicalization.

See examples of how things can be done well and how things can go really, really wrong. Topics include building search-friendly search architecture, including  URL structure, rich media (such as Flash, video, AJAX), and managing bots.

Duplicate Content Solutions and the Canonical Tag
Many site infrastructure scenarios introduce duplicate content, which can hinder effective search engine crawling, indexing, and ranking. The search engines can’t efficiently crawl the site, which can lead to less of the site being indexed, and links pointing to multiple versionis of content can cause PageRank dilution, which can lead to lowered rankings.

Tracking codes on URLs, parameters for sort orders, separate pages for very similar items (such as identical products in different colors), and page revision history (such as a wiki-style site that provides access to earlier versions of pages) can all cause these duplicate content issues.

Recently, the search engines introduced a new tool to help combat duplicate content issues: the canonical tag. This session looks and how the tag has been performing for some webmasters plus revisits other duplicate content tools and techniques.

SEO Ranking Factors in 2009
How much does that H1 tag really matter, versus the number of links pointing at a domain? Do “authority” sites always have an advantage over other sites with less reputation. Is brand recognition now a bigger issue? This session looks at on-the-page and off-the-page factors that influence web search, to understand what remains useful and what new signals are growing in importance.

Is Your Hosting Ready For Social Media Success?
Congratulations! You just made it to the home page of Digg. And seconds later, your server crashed, taking with it the chance for all those eyeballs to see your content. In this session, a look at how to ensure that your hosting provider and content management systems are ready for what social media might send, when something goes viral.

You&A With Matt Cutts
What’s a You&A? That’s where you, the audience, put your questions directly to the head of Google’s web spam team, Matt Cutts. As an engineer in search quality, Matt’s been dealing with webmaster issues for Google since 2000 and is well known to many advanced search marketers from his blog and public speaking.

Day 2:

Keynote Q&A: Dr. Qi Lu, President, Online Services Division, Microsoft
Dr. Qi Lu took the helm of Microsoft’s search efforts in January. Now six months into his new role, during this keynote Q&A with Search Engine Land editor-in-chief Danny Sullivan, Lu shares in this some of the changes that have been made to Microsoft Live Search and where the company intends to head in the search space.

Conducting an SEO Audit to Troubleshoot Problems and Tune-Up Performance
Has something gone wrong with your organic search engine traffic? An SEO audit might be in order. This session covers how to conduct an efficient audit that troubleshoots real problems, rather than taking you down blind alleys. It also helps you reassess your current SEO efforts for areas that can be tweaked and improved.

Flash and Search
Flash content has historically been problematic for search engines to index, although it’s been nearly a year since Google & Yahoo gained more support to index Flash content. This session takes a close look at how that’s playing out in real life. Can you just leave it to the crawlers to understand Flash now? Do you still need to consider alternatives to help them? Get up to speed on the current state of how search engines interact with Flash.

Mega Session: SEO Vets Take All Comers
This PowerPoint-free panel is made up of veteran search engine optimization experts taking questions on SEO issues. Put your biggest challenges to them and come away with solutions.

Jane and Robot Presents After-Hours Technical Q&A with the Experts
After two days of tech sessions, get answers to all of your technical questions from our panel of experts. Stay tuned for more details!

Networking and Topic Tables

In addition to all of this great content, you’ll have access to all networking events and topic-focused lunch tables on both days. We’ll have industry leaders in search and development leading discussions and Q&A during lunch for additional opportunities to get your technical search questions answered.

Use discount code jr@SMX for 10% off registration.

SEO/Webdev Meetup Wed May 6th in Mountain View

May 5, 2009

If you’re in the bay area tomorrow night (May 6th), come out to the next Jane and Robot SEO/webdev meetup at the Microsoft campus in Mountain View. Sean Suchter, who has done tons with search (including running Yahoo search for a while, before recently joining Microsoft search) will be joining me to talk about all things search, so bring your technical SEO questions or just come to hang out and have some free pizza and drinks!

We’ll be meeting from 7-10pm and you can sign up at upcoming. Hope to see you there!

And if you’re out at eMetrics in San Jose, come out to my search session on Thursday morning!

Whitehouse.gov Keeping Searchers From Asking Questions (Inadvertently)

March 25, 2009

Yesterday on the O’Reilly Radar blog, I posted that a key component of the American government’s initiative to be transparent and open with its data is to ensure content from government web sites is available through the major search engines. Tomorrow, I’ll follow that up with a post that details some of the specific obstacles that are blocking them now and how they might become more search engine-friendly.

While I was working on that post today, I checked out the new section of whitehouse.gov called “Open for Questions“. Since this is a brand new feature and has been talked up quite a bit online, I thought it would be a good study on government efforts do in search.

The trouble with Google Moderator

Open for Questions uses Google Moderator, which as I’ve previously posted, is a black hole for search engines. That’s unfortunate, since people who are searching for information on health care reform, financial stability, or the environment would likely benefit from finding a lively discussion on whitehouse.gov with concerns from fellow citizens. Another of Google Moderator’s drawbacks is that it doesn’t provide a unique URL for each topic, so for instance, if I wanted to email a link to the discussion about retirement security to my mom or post a link to the education discussion on Facebook, I couldn’t. The best I could do is tell people to go to http://www.whitehouse.gov/OpenForQuestions/ and then scroll to the topic and click on it. If I wanted to share a specific question from one of those topics? Not a chance.

The semantic structure of the page

I then noticed that the title tag of the page uses the text “Open For Questions” with no additional clue that this page is part of whitehouse.gov or that these questions are intended to be from citizens to the White House. That’s not great for either search ranking or search acquisition. If searchers see a listing in the search results for “Open For Questions”, it could mean anything. (Much of whitehouse.gov has title tag issues.)

The heading on the page is “Your Questions on the Economy”. That’s kind of confusing, since you can use the topic navigation to ask questions about all kinds of things. And the heading is in a span class, not an H1, so it doesn’t signal clearly to search engines that this is what the page is about. The text mentions “Thursday”, but no date, which makes me wonder if these discussions will no longer be online after tomorrow. If they are, having the date on the page from the start would make the page a lot easier to maintain later.

Of course, since all of the text is pulled in from Google Moderator via JavaScript, the search engines (and possibly those on mobile devices, screen readers, and older browsers) can’t access any of it anyway. Instead any of those users see this: “Google Moderator is a tool that allows distributed communities to submit and vote on questions for talks, presentations, and events. You must have JavaScript enabled in order to use this feature.”

The real problem: indexability

But as it turns out, all of those obstacles are inconsquential. A search for [white house open for questions] brings up lots of pages that reference the feature, but not the http://www.whitehouse.gov/OpenForQuestions/ page itself.

White House Open For Questions

White House Open For Questions

I was initially surprised because even though much of the content on the page is inaccessible to search engines, the pages has lots of links with descriptive anchor text. And then I realized this isn’t a ranking problem, it’s an indexing problem.

White House Open For Questions, Not Indexing

White House Open For Questions, Not Indexing

Surely the search engines have seen the page by now. I checked robots.txt but didn’t see anything blocking it. And then I looked at the source code. There it was.

<meta content=”noindex,nofollow name=”robots/>

They didn’t follow the first rule of indexing.

My guess is that blocking search engines is either accidental (which happens all the time when pages are first launched, since they are often blocked during the development phase) or this page is intended to be only temporary, meant to gather questions for a short period of time, but not keep them as an archive later. I hope the latter isn’t the case, because I think having a repository of the questions Americans care about most can be very useful for a number of reasons.

How can this be fixed?

It may be difficult to fix the issues with indexing Google Moderator content (and that’s really something I wish Google itself would address), but it should be fairly simple to expose the “Open for Questions” landing page to search engines. Just remove the meta robots tag, make the title a bit more descriptive (“Open For Questions: Ask the White House About Your Concerns”), and add a paragraph of text that’s outside of JavaScript that describes what the feature is about. And in the short term, perhaps the content could be exported to an HTML file once questions are closed so they could be searched over later.

Check O’Reilly Radar tomorrow for more tips on how the government can make its content more findable.

GoDaddy Superbowl Ad: Sex Still Sells (and Influences Searches)

February 4, 2009

When I saw the GoDaddy Superbowl ads I thought, Oh GoDaddy. There you go again. It was so typical and expected of them, I couldn’t even bring myself to be offended. But I did wonder, was it really working? Sure, an ad with two naked women in a shower that ends with a message to check out the web site to see how the scene ends would drive traffic to the site, but would it be qualified traffic? Would any of the video seekers actually register domains and start web sites?

Apparently so. GoDaddy said they gained a “record number of new customers and total orders” from the ads, a 110% increase over last year’s Superbowl.

Clearly, the ads drove people to search. [godaddy] was the #3 hot trends by game’s end and remained at #21 hours later.

TV ads inspire searches and as long as you can be found for what people are searching for, those searches can inspire clicks. And those clicks lead to purchases. It’s a formula that works.

GoDaddy was smart to stay focused on their brand name, which they already ranked #1 for, rather than send viewers to a microsite devoted to the Superbowl videos.

As Wired points out, the ads themselves didn’t work for everyone. But their use of online video integrated with an offline campaign and easy discoverability in search can definitely work for most businesses, even when they choose a subject matter a little less likely to lead to boycotts.

Superbowl Commercials: What About Search Acquisition?

February 2, 2009

Yesterday on Search Engine Land, I scored the search presence of select Superbowl advertisers. Most had some presence, but not necessarily for what people were searching for, and in many cases, the search results display was abysmal.

Two big problems I saw were:

  • Overuse of microsites
  • Failure to check (and fix) the search results display

Below are some examples of what things looked like yesterday. This week, I’ll dive more into the details of some particular ads.

Microsites

Microsites caused several problems, notably confusion in the results (which site is right?) and lack of visibility for the query sparked by the ad.

Hyundai
In my Search Engine Land article, I listed all of the various sites I found for Hyundai. Based on Google Hot Trends data, people seemed particularly interested in the Hyundai Genesis Coupe. The domain Hyundai flashed for the coupe was edityourown.com. This caused a flurry of searches for [edit you own].

However, since edityourown.com redirects to hyundaigenesis.com/coupe, the domain is nowhere to be found for those searchers.

The words “edit your own” are on the hyundaigenesis.com site in Flash:

The page only seems to show up if you do a site restrict search for the query.

Sobe
Hyundai wasn’t the only brand having trouble with redirecting microsites. Sobe advertised their Lifeworks drink with the domain sobelieve.com. But again, when you search for that exact term? The site is nowhere to be found.

That’s because (you guessed it), sobelieve.com redirects to sobeworld.com. And searchers are left confused.

Results display

It’s also good practice to check not only how your brand ranks in search, but what that result looks like. And you definitely should give things a quick look before launching a huge awareness campaign like a Superbowl ad. Let’s take a look.

Sprint
Spring had some trouble, at least partially caused by Flash. Flash issues seemed to be recurring theme with display issues this year. In this case, the snippet is missing entirely.

And here, the text that compels searchers to click is from an Atlas tracking code.

Verizon
But Sprint wasn’t the only wireless provider with issues. Verizon didn’t provide a super compelling result either:

Miller Highlife
Miller has snippet issues, title issues, and multiple site confusion, but it does have great universal results with its YouTube videos! (If only Miller had uploaded themselves, they could have branded them with a URL in the descriptions and at the end of the videos.)

Monster.com
Monster.com is advertising “the best job in the NFL”, and they’ve got a great paid search result. Unfortunately, while they also have the number one organic spot, it’s a little, ahem, loud.

It’s not enough to rank well. Does the well-ranked result really compel searchers to click?

Google Misspelling Match: A Tale Of Two Searches

January 27, 2009

As a collective people, we aren’t always the greatest spellers. Even those of us (ahem) with English degrees have our weaknesses (as you’ll see in a minute). Knowing that, site owners have long wondered about how best to make sure their sites show up in search engines for misspelled queries.

Read more…

Web Development/SEO Meetup, This Thursday January 22nd in Mountain View

January 19, 2009

We’ve had several Jane and Robot webdev/SEO meetups in Seattle and they’ve been lots of fun, so we’ve decided to take things on the road! We’re planning to do several in the bay area (and at least one in LA) and the first one is this Thursday, January 22nd at Ooyala in Mountain View.

Nate and I will be on hand to answer all your pressing search-related questions, so if you’re a web developer who wants to learn more about making web apps search-friendly or if you’re an SEO who’s interested in the technical side of search engine optimization, come on out! We’ll get things started around 6 and start the questions around 7. If you plan to attend and would like a mini site review, just post the URL here, along with your questions.

There should be plenty of time for networking, and lots of drinks and snacks!

RSVP and get directions at Upcoming.

Upcoming webdev/search conferences

And if you’re interested in the techie side of SEO, don’t miss Developer Day at SMX West in Santa Clara, CA on February 10th. If you’re a marketer who works with developers, this a great opportunity to learn the marketer-to-developer translation glossary, and if you’re a developer looking for a primer on the technical side of SEO, you should definitely check it out.

And of course the O’Reilly Found conference, which Nate and I are developing specifically for web developers is coming up June 9-11 in Burlingame, CA. We’re finalizing the agenda now, so if you’ve pitched to speak, expect to hear back from us soon. We’ll be opening registration next month, so in the meantime, sign up for the newsletter to stay up to date with the latest.

Hope to see you all on Thursday!

A Short Case Study on Redirects: 301s vs. 302s

January 5, 2009

When I moved to this site a couple of months ago and redirected the old blog to this one, I experienced the joys and sorrows that we all do when we move sites. I was redirecting at several levels. From the .htaccess file of the old site, I was doing a site-wide redirect. From the .htaccess file of the new site, I was redirecting from the old URL pattern to the new one (and from the non-www version to the www version). Wordpress itself was also redirecting, for instance, from the version of the URL without the slash to the version with it. Within .htaccess, some redirects use RedirectMatch, others use Redirect, and others are really URL rewrites using mod_rewrite.

I also redirected my feed using .htaccess and Feedburner, and am still sorting out how (and if you really can) redirect and consolidate (even if you’re using MyBrand).

There’s a lot going on and I intentionally unleashed it using all kinds of variations to see what would happen. For you. Surely someone will send me a cookie.

The difference between 301s and 302s

I have a whole set of notes that I’m writing up on all the different redirection options and what the pitfalls are, but for now, I wanted to illustrate the difference between a 301 and a 302. I am asked this a lot (“does it really make a difference?). It can get confusing, because although search engines say to use a 301 when moving a site (or page), server software tends to use a 302 as the default when you implement a generic redirect (without specifying if it should be a 301 or 302).

Some of the redirects for my site move were initially implemented as 302s and others as 301s, so I could see how things worked in real time.

A 302 is a “temporary” redirect

Search engines tend to interpret a 302 as an instruction to index the old URL but the new content. It keeps the old URL because the server has said that the new one is only “temporary”. You can see that here with a Google search for my name. As you can see, the URL is for the old site, but the title and description in the search result are from the new one.

A 301 is a “permanent” redirect

Search engines interpret a 301as an instruction to replace the old URL with the new one. As you can see, once I changed the redirect to 301, the new URL showed up in the place of the old one.

The new URL is ranking in the same location for the query [vanessa] as the old URL was, which implies that the links and anchor text that pointed to the old URL are now being transferred to the new URL. In addition, you might notice that the URL I’m redirecting my old home page to (www.ninebyblue.com/blog/) has a toolbar PageRank of 6, while the home page of this site (www.ninebyblue.com) has a toolbar PageRank of 4, so at least in terms of visible toolbar PageRank, that credit is passed via the 301 as well.

Should you use a 301 or 302?

As you can see, for a permanent site (or page) move (and to consolidate duplicate pages), a 301 is the way to go, and you should check with the details of your implementation to make sure that your redirect really is happening via 301.

For more details:

Learn more up close and personal!

If you’re geeky like me, and want more techie stuff, come on out to SMX West Developer Day in February or the O’Reilly Found conference in June! Both are shaping up to be quite geeky, and by that I mean, very fun.

Last Chance to Submit a Speaking Proposal for the O’Reilly Found Conference!

December 16, 2008

 

Tomorrow is the last day to submit a speaking proposal for the O’Reilly Found conference. I’m co-chairing the  conference with Nate Buggia, who runs the Microsoft Live Search Webmaster Center. Found is a conference for web developers that focuses on the technical issues involved with building web sites that are search engine-friendly.

We particularly would like to hear from you if you:

  • Are a developer who has real-world experience making web infrastructure (LAMP stack, Microsoft stack, CMS systems, ecommerce systems, etc.) easily crawlable by search engines.
  • Are a developer who’s run into big search engine issues with your web app and have diagnosed things and lived through it. Tell us about your battle scars!
  • Manage developers or work with developers and have developed successful SEO processes that build search-friendliess into the development cycle.
  • Work for a company that provides infrastructure that makes SEO-friendly develoment easier.
  • Have case studies, metrics, and stories you can share about the importance of search today and how vital the technical side of development is to SEO.

Since time is running out, feel free to send a paragraph or two over about what you’d like to talk about and we can contact you to work out the details.

The conference is in the San Francisco area in June. If you’d like to attend, look for registration details early next year. And comment here, email, or use the conference site wiki to tell us what issues you’d like to hear more about at the conference!

  • Nine By Fox

    Stories from the online marketing industry, Vanessa's travel adventures, and more. For reference material and analysis, see the Library.
  • Buy the Book!

  • Categories

  • The Latest From Twitter