Drive To Discover
Silicon Valley's new buzzword
Apps are so yesterday. There's a new buzzword in Silicon Valley: Big Data. It's a phenomenon driven by the likes of Google and Facebook. When you make a connection on Facebook, you can thank Big Data. When you get a flu shot, you can thank Big Data.
It's a field so new that few schools offer a degree in it. Yet demand is surging for data scientists, the hottest job title in Silicon Valley.
"For most companies right now," says Amrit Williams, "the real problem with getting value out of data is a lack of sophistication in talent. We have a major drought of qualified people who can ask the right questions."
Williams is chief technology officer of Emeryville-based Quantivo, one company in the vanguard of a new Big Data industry, developing analytical tools for business big and small.
"People are looking at all this data, going, 'I know it's interesting for me to collect Twitter data. I know it's interesting for me to understand what my customers are doing on Facebook. I know it's interesting for me to understand what they do online. But what's the question I'm trying to ask? And what's the answer I want?'"
For the first time, Big Data has its own convention, the Strata conference, inaugurated by O'Reilly Media of Sebastopol -- where Edd Dumbill's job is to stay in front of this trend.
"For a lot of people," he says, "the first Strata conference crystalized that they were data scientists, there were other people who were data scientists, so this is a profession, working with large datasets. And now it's a highly-in-demand job title."
For years, big retailers collected volumes of data about their customers. But they struggled to make sense of it. There was too much, and it was too unstructured. Then came the perfect storm: cloud computing, open source, and Internet companies that eat whole planets of data for breakfast. Now Google and others are sharing their technology.
jobs, silicon valley, computers, google, facebook, drive to discover
- Family: Children's Hospital calls girl 'dead'
- Senator Harry Reid in hospital for observation
- BART Board president wants to ban transit strikes
- 'Wonder Girl' cancer patient is inspiration for Vallejo
- Garbage truck fatally strikes man in Tenderloin 22 min ago
- Car crashes into San Jose home this morning
- SFFD battle 1-alarm blaze near the Panhandle
- San Jose charity 3,000 short of toy distribution goal 15 min ago
- '628' area code to begin in '415' region in 2015
- VIRAL VIDEO: Oscars® Trailer: Ellen...
- abcnews: Dancing doctor gets tickets to Beyonce show
- Bay Area New Year's Eve fireworks and events
- roundup: CPUC fines PG&E; Homeless memorial
- weather: Bay Area weather forecast for Friday
Most Viewed StoriesMost Viewed Photos