Tags > data

Four short links: 21 December 2011 - Be a Data Hound, Secure Traveling, Secure SMS, Mozilla's Wider Focus

By Nat Torkington
December 21, 2011

AntiMap -- open source Android software to gather arbitrary data and visualize it. This enables you to be a 21C Francis Galton, the man who walked the streets of England using a pin to prick holes on a cross of card in his pocket, all to keep track of the relative average beauty of women in different parts of...

Four short links: 20 December 2011 - Maximum MySQL, Digital News, Unbiased Mining, and Congressional Clue

By Nat Torkington
December 20, 2011

How Twitter Stores 250M Tweets a Day Using MySQL (High Scalability) -- notes from a talk at the MySQL conference on how Twitter built a high-volume MySQL store. How The Atlantic Got Profitable With Digital First (Mashable) -- Lauf says his team has focused on putting together premium advertising experiences that span print, digital, events and (increasingly) mobile. Data...

There's a map for that - Can redistricting be opened to the public through open source and the web?

There's a map for that - Can redistricting be opened to the public through open source and the web?
By Alex Howard
December 20, 2011

DistrictBuilder is a web-based redistricting tool that lets citizens draw their own maps, publish them online and submit them to redistricting authorities.

Six API predictions for 2012 - In the year to come, APIs will continue to transform into core business tools.

By Anant Jhingran
December 19, 2011

Among the key API trends to watch in 2012: enterprise APIs will go mainstream, data-centric APIs will become common, and APIs will need to be optimized for mobile apps and developers.

Big crime meets big data - Data and social media are being used against us in creative new ways.

Big crime meets big data - Data and social media are being used against us in creative new ways.
By Ciara Byrne
December 19, 2011

Marc Goodman, consultant and cyber crime expert, explains how criminals and terrorists can put data, automation, and scalability to effective use.

Top Stories: December 12-16, 2011 - Five data predictions for 2012, a Kindle Single and long-form journalism, and the frustrations of the mobile experience.

Top Stories: December 12-16, 2011 - Five data predictions for 2012, a Kindle Single and long-form journalism, and the frustrations of the mobile experience.
By Mac Slocum
December 16, 2011

This week on O'Reilly: Edd Dumbill offered five big data predictions for the year to come, Marc Herman discussed his new Kindle Single and how that platform could help long-form journalism, and Joshua Bixby examined mobile frustrations and expectations.

Visualization of the Week: Mapping traffic casualties - A BBC visualization maps every traffic casualty in the UK between 1999-2010.

Visualization of the Week: Mapping traffic casualties - A BBC visualization maps every traffic casualty in the UK between 1999-2010.
By Audrey Watters
December 16, 2011

More than a decade's worth of traffic accident data is plotted out in a BBC visualization. Locations with a history of accidents are hard to miss.

White House to open source Data.gov as open government data platform - The new "Data.gov in a box" could empower countries to build their own platforms.

White House to open source Data.gov as open government data platform - The new
By Alex Howard
December 5, 2011

A partnership between the United States and India on open government has borne fruit: progress on making the open data platform Data.gov open source. With this step forward, the prospects are brighter for stimulating economic activity, civic utility and accountability under a global open government partnership.

Why cloud services are a tempting target for attackers - Jeffrey Carr on the significant and escalating risks of hosting data with cloud providers.

Why cloud services are a tempting target for attackers - Jeffrey Carr on the significant and escalating risks of hosting data with cloud providers.
By Jeffrey Carr
December 5, 2011

Before organizations embrace the efficiencies and cost savings of cloud services, they should also closely consider the security repercussions and liabilities attached to the cloud.

Top Stories: November 28-December 2, 2011 - Info overload vs. consumption, how big data is shaping business, and why we need the "paperless book."

Top Stories: November 28-December 2, 2011 - Info overload vs. consumption, how big data is shaping business, and why we need the
By Mac Slocum
December 2, 2011

This week on O'Reilly: Author Clay Johnson explained why information consumption, not overload, is what needs to be managed. Also, Alistair Croll looked at the relationship between business intelligence and big data, and Todd Sattersten made a case for the paperless book.

Visualization of the Week: Amazon book recommendations - Christopher Warnow's viz app reveals the network of recommendations surrounding a book.

Visualization of the Week: Amazon book recommendations - Christopher Warnow's viz app reveals the network of recommendations surrounding a book.
By Audrey Watters
December 2, 2011

A new tool takes a link from a book on Amazon and creates the network surrounding it. It shows up to 100 recommendations associated with the title.

Gov 2.0 enters the mainstream on NPR and the AP - NPR and the Associated Press recently focused on civic apps and other Gov 2.0 topics.

By Alex Howard
December 1, 2011

Civic applications recently pushed a bit further into the public's consciousness via a lively discussion on Washington's local NPR station, WAMU, and through an Associated Press article that examined open data and apps.

Strata Week: New open-data initiatives in Canada and the UK - Open data from StatsCan and Whitehall, Dell open sources its Hadoop tool, and what we can learn from old library records.

Strata Week: New open-data initiatives in Canada and the UK - Open data from StatsCan and Whitehall, Dell open sources its Hadoop tool, and what we can learn from old library records.
By Audrey Watters
December 1, 2011

This week's data news includes open-data initiatives in the U.K. and Canada, the open sourcing of a Hadoop deployment tool by Dell, and a database reveals the circa-1900 reading habits of Muncie, Ind.

A young entrepreneur's perspective on Angolan innovation - Angolan entrepreneur Nyanga Tyitapeka on mobile commerce and data's potential.

By Suzanne Axtell
December 1, 2011

Infonauta founder Nyanga Tyitapeka says Angola is on the cusp of a technology explosion. Mobile and data are overcoming low levels of literacy to change the lives of everyday Angolans.

Strata Newsletter: November 30, 2011 - The rise of Clojure and a look at the design behind data visualizations.

Strata Newsletter: November 30, 2011 - The rise of Clojure and a look at the design behind data visualizations.
By Mac Slocum
December 1, 2011

Highlights from the 11/30/11 edition of the Strata newsletter include: Clojure is a rising star in the data world, a look at the top data news, and a deep dive into data visualization design.

Four short links: 28 November 2011 - Ubicomp Project, Data Volumes, Yahoo! Cocktails, and Fighting Cybercrime

By Nat Torkington
November 28, 2011

Twine (Kickstarter) -- modular sensors with connectivity, programmable in If This Then That style. (via TechCrunch) Small Sample Sizes Lead to High Margins of Error -- a reminder that all the stats in the world won't help you when you don't have enough data to meaningfully analyse. Yahoo! Cocktails -- somehow I missed this announcement of a Javascript front-and-back-end...

Visualization of the Week: The big chart of money - Randall Monroe's new visualization puts money (almost all of it) in perspective.

Visualization of the Week: The big chart of money - Randall Monroe's new visualization puts money (almost all of it) in perspective.
By Audrey Watters
November 25, 2011

In an audacious new visualization, Randall Monroe of xkcd takes on money — where it comes from, where it goes and what it buys.

Strata Week: 4.74 degrees of Kevin Bacon - Facebook says we're closer than we thought, Gnip targets finance, and eBay grabs Hunch.

Strata Week: 4.74 degrees of Kevin Bacon - Facebook says we're closer than we thought, Gnip targets finance, and eBay grabs Hunch.
By Audrey Watters
November 22, 2011

Facebook research questions the "six degrees of separation" rule, Gnip gets into the real-time financial data business, and eBay looks to put Hunch's recommendation engine to use.

Visualization of the Week: A better U.S. migration map - Jon Bruner updates his "American Migration" viz with more data and new code.

Visualization of the Week: A better U.S. migration map - Jon Bruner updates his
By Audrey Watters
November 18, 2011

Jon Bruner's new and improved "American Migration" visualization lets you click on a specific U.S. county and see where folks move from and where they move to.

Strata Week: Why ThinkUp matters - ThinkUp and data ownership, DataSift turns on its Twitter firehose, and Google cracks opens the door to BigQuery.

Strata Week: Why ThinkUp matters - ThinkUp and data ownership, DataSift turns on its Twitter firehose, and Google cracks opens the door to BigQuery.
By Audrey Watters
November 17, 2011

Data democratization gets an important new tool with the release of ThinkUp 1.0. Also, DataSift offers another way to get the Twitter firehose, and Google offers a little more access to its BigQuery data analytics service.

Publishers need broader and broader shoulders - From HTML5 to metadata to managing rights, increasingly complex content management issues fall squarely on publishers.

Publishers need broader and broader shoulders - From HTML5 to metadata to managing rights, increasingly complex content management issues fall squarely on publishers.
By Joe Wikert
November 16, 2011

It's more challenging than ever to handle all aspects of content management internally. In this podcast, Firebrand Technologies founder and president Fran Toolan addresses a myriad of content management issues.

Helping educators find the right stuff - The Learning Registry looks to crack the education resource discovery problem.

Helping educators find the right stuff - The Learning Registry looks to crack the education resource discovery problem.
By Marie Bjerede
November 15, 2011

There are countless repositories of high-quality content available to teachers, but it is still nearly impossible to find content to use with a particular lesson plan for a particular grade aligned to particular standards. That's where the Department of Education's new Learning Registry comes in.

Civic media competition attracts a new generation of change agents - A global conversation with finalists in Ashoka's civic media innovation competition.

Civic media competition attracts a new generation of change agents - A global conversation with finalists in Ashoka's civic media innovation competition.
By Alex Howard
November 14, 2011

Finalists in the Ashoka Foundation's civic media competition offered honest and perceptive observations about the role of civic media in the expanding information ecosystem.

Visualization of the Week: 138 Years of Popular Science - Data artist Jer Thorp visualized the Popular Science archive.

Visualization of the Week: 138 Years of Popular Science - Data artist Jer Thorp visualized the Popular Science archive.
By Audrey Watters
November 11, 2011

This week's visualization shows how data artist Jer Thorp depicted more than a century's worth of content from Popular Science.

Access or ownership: Which will be the default? - The ease of access and the desire to own appear to be on a collision course.

Access or ownership: Which will be the default? - The ease of access and the desire to own appear to be on a collision course.
By Mac Slocum
November 10, 2011

Business, media, publishing, data, education — these are all areas where access vs. ownership has organically popped up in Radar's coverage. But which model will win out in the long term?

Looking for KDD contenders - Trying to crack a tough data problem? Submit it to the KDD Cup challenge.

Looking for KDD contenders - Trying to crack a tough data problem? Submit it to the KDD Cup challenge.
By Mike Loukides
November 10, 2011

Organizers of this year's KDD Cup data mining challenge are looking for data problems in areas such as medicine, education, the environment, or anything that leads to a social good. Submissions are due by November 15.

Strata Week: The social graph that isn't - Pinboard founder questions the social graph, Cloudera and Kaggle raise money for big data.

Strata Week: The social graph that isn't - Pinboard founder questions the social graph, Cloudera and Kaggle raise money for big data.
By Audrey Watters
November 10, 2011

In this week's data news, Pinboard founder Maciej Ceglowski challenges the notion of a "social graph," Cloudera and Kaggle raise money for big data, and the Supreme Court looks at GPS and privacy issues.

Social network analysis isn't just for social networks - Social network analysis (SNA) finds meaningful patterns in relationship data.

Social network analysis isn't just for social networks - Social network analysis (SNA) finds meaningful patterns in relationship data.
By Howard Wen
November 9, 2011

The scientific methodology of social network analysis (SNA) helps explain not just how people connect, but why they come together as well. Here, "Social Network Analysis for Startups" co-author Maksim Tsvetovat offers a primer on SNA.

Top Stories: October 31-November 4, 2011 - An author turns to automation, a look at privacy in the age of big data, and a simple rule for data ethics.

Top Stories: October 31-November 4, 2011 - An author turns to automation, a look at privacy in the age of big data, and a simple rule for data ethics.
By Mac Slocum
November 4, 2011

This week on O'Reilly: Former author Robbie Allen explained his shift to software-generated writing, Terence Craig said transparency is the best way to handle digital privacy, and we learned how a simple question can keep data companies honest.

Visualization of the Week: How dance music travels - "The Evolution of Western Dance Music" plots the spread of dance genres.

Visualization of the Week: How dance music travels -
By Audrey Watters
November 4, 2011

A visualization traces 100 years of Western dance music, showing how genres are seamlessly imported and exported across continents.

Why developers should enter health IT contests - Developers can make money writing code that makes patients safer.

By Fred Trotter
November 4, 2011

Working on software that addresses patient safety issues is one of the few ways that a software developer can impact quality of life rather than convenience of life. Health contests are fun enough that you might even forget that you're changing the world.

Four short links: 4 November 2011 - Science Repository, Dancing Robots, Retro Jobs, and Bluetooth Bow

By Nat Torkington
November 4, 2011

Beethoven's Open Repository of Research (RocketHub) -- open repository funded in a Kickstarter-type way. First crowdfunding project I've given $$$ to. KeepOff (GitHub) -- open source project built around hacking KeepOn Interactive Dancing Robots. (via Chris Spurgeon) Steve Jobs One-on-One (ComputerWorld) -- interesting glimpse of the man himself in an oral history project recording made during the NeXT years....

Strata Week: Cloudera founder has a new data product - Odiago hints at the future of Hadoop-based services, Hortonworks shows off its products, and big data comes to edu material.

Strata Week: Cloudera founder has a new data product - Odiago hints at the future of Hadoop-based services, Hortonworks shows off its products, and big data comes to edu material.
By Audrey Watters
November 3, 2011

Cloudera's founder launches Odiago, a new data startup. Elsewhere, Hortonworks reveals its suite of Hadoop products and services, and Knewton and Pearson bring big data to education content.

How I automated my writing career - A former author uses data and software to take the tedium out of some kinds of writing.

How I automated my writing career - A former author uses data and software to take the tedium out of some kinds of writing.
By Robbie Allen
November 3, 2011

You scale content businesses by increasing the number of people who create the content ... or so conventional wisdom says. Learn how a former author is using software to simulate and expand human-quality writing.

The number one trait you want in a data scientist - DJ Patil on the traits of data scientists and how data science will evolve within companies.

The number one trait you want in a data scientist - DJ Patil on the traits of data scientists and how data science will evolve within companies.
By Audrey Watters
November 3, 2011

DJ Patil, data scientist in residence at Greylock Partners, discusses the key trait data scientists need and the obstacles data scientists face within organizations.

Four short links: 3 November 2011 - Getting Feedback, Colour Design, Discovering Musicians, Weather Prediction App

By Nat Torkington
November 3, 2011

Feedback Without Frustration (YouTube) -- Scott Berkun at the HIVE conference talks about how feedback fails, and how to get it successfully. He is so good. Americhrome -- history of the official palette of the United States of America. Discovering Talented Musicians with Musical Analysis (Google Research blgo) -- very clever, they do acoustical analysis and then train up...

What does privacy mean in an age of big data? - Author Terence Craig on why data transparency trumps anonymization.

What does privacy mean in an age of big data? - Author Terence Craig on why data transparency trumps anonymization.
By Audrey Watters
November 2, 2011

Ironclad digital privacy isn't realistic, argues "Privacy and Big Data" co-author Terence Craig. What we need instead are laws and commitments founded on transparency.

Demoting Halder: A wild look at social tracking and sentiment analysis - You no longer have control over where a first impression occurs.

By Andy Oram
November 1, 2011

My short story, "Demoting Halder," was supposed to lay out an alternative reality where social tracking and sentiment analysis had taken over society. As the story evolved, I wondered if the reality in the story is something we're living right now.

If your data practices were made public, would you be nervous? - Solon Barocas on data mining's reputation and the ethics of data collection.

If your data practices were made public, would you be nervous? - Solon Barocas on data mining's reputation and the ethics of data collection.
By Audrey Watters
November 1, 2011

Solon Barocas, a doctoral student at New York University, discusses consumer perceptions of data mining and how companies and data scientists can shape data mining's reputation.

Four short links: 31 October 2011 - Solitude and Leadership, Data Repository, Copyright History, and Open Source Audio

By Nat Torkington
October 31, 2011

Solitude and Leadership -- an amazing essay on the value of managing one's information diet. Far more than yet another Carr/Morozov "the Internet is making us dumb!!" hate on short-form content, this is an eloquent exposition of the need for long-form thoughts. I find for myself that my first thought is never my best thought. My first thought is...

Sensors, data, UI and the future of publishing - Tweets and related information from Tim O'Reilly's Silverchair Strategies 2011 presentation.

By Mac Slocum
October 28, 2011

In a recent keynote address, Tim O'Reilly looked at how sensors, data and interfaces will shape information delivery.

Visualization of the Week: 7 billion humans - One UN population dataset yields two different visualizations.

Visualization of the Week: 7 billion humans - One UN population dataset yields two different visualizations.
By Audrey Watters
October 28, 2011

Two visualizations, one from the United Nations and the other from The Guardian, illustrate world population growth at the global and country level.

Four short links: 28 October 2011 - Open Access, Retro Crypto, Open Source Q&A, and Music Visualization

By Nat Torkington
October 28, 2011

Open Access Week -- a global event promoting Open Access as a new norm in scholarship and research. The Copiale Cipher -- cracking a historical code with computers. Details in the paper: The book describes the initiation of "DER CANDIDAT" into a secret society, some functions of which are encoded with logograms. (via Discover Magazine) Coordino -- open source...

Strata Week: IBM puts Hadoop in the cloud - IBM taps the cloud to make Hadoop easier, Factual cleans geo data, Google gets transparent with gov data requests.

Strata Week: IBM puts Hadoop in the cloud - IBM taps the cloud to make Hadoop easier, Factual cleans geo data, Google gets transparent with gov data requests.
By Audrey Watters
October 27, 2011

IBM targets businesses with a cloud-based Hadoop product, Factual tackles incomplete geo records, and Google embraces transparency by publishing and explaining the data requests it gets from governments.

Mobile analytics unlock the what and the when - Flurry's Sean Byrnes on mobile metrics and tablet apps vs phone apps.

Mobile analytics unlock the what and the when - Flurry's Sean Byrnes on mobile metrics and tablet apps vs phone apps.
By Jenn Webb
October 26, 2011

Flurry's CTO Sean Byrnes discusses app life cycles, the specifics of user engagement, and the difference between smartphone apps and tablet apps.

Four short links: 26 October 2011 - CPAN's Sweet 0x10, Social Reading, Questioning Polls, and 3D Manufacturing

By Nat Torkington
October 26, 2011

CPAN Turns 0x10 -- sixteenth anniversary of the creation of the Comprehensive Perl Archive Network. Now holds 480k objects. Subtext -- social bookreading by adding chat, links, etc. to a book. I haven't tried the implementation yet but I've wanted this for years. (Just haven't wanted to jump into the cesspool of rights negotiations enough to actually build it...

Visualization of the Week: Occupy George - Infographics printed on $1 bills circulate Occupy Wall Street's message.

Visualization of the Week: Occupy George - Infographics printed on $1 bills circulate Occupy Wall Street's message.
By Audrey Watters
October 21, 2011

Occupy George, an extension of the Occupy Wall Street protests, looks to print infographics on $1 bills so the message floats with the currency.

Top Stories: October 17-21, 2011 - The joys of animated geo data, Angry Birds and the future of mobile testing, and a look inside The Guardian's creative process.

Top Stories: October 17-21, 2011 - The joys of animated geo data, Angry Birds and the future of mobile testing, and a look inside The Guardian's creative process.
By Mac Slocum
October 21, 2011

This week on O'Reilly: Andy Kirk explained why data, maps and animation work so well together, we discovered the connection between a game-playing robot and the future of mobile app testing, and we learned how The Guardian develops its data journalism.

Publishing News: The news is free but the API will cost you - New revenue streams for news orgs, Amazon gnaws away at the publishing industry, and Kobo launches Vox.

Publishing News: The news is free but the API will cost you - New revenue streams for news orgs, Amazon gnaws away at the publishing industry, and Kobo launches Vox.
By Jenn Webb
October 21, 2011

News organizations look to commercial endeavors for unorthodox revenue. Also, Amazon continues to extend its reach into publishing and Kobo jumps on the tablet bandwagon.

Note to visualization creators: Add subtitles and narration - Embedded information makes animated visualizations more accessible.

Note to visualization creators: Add subtitles and narration - Embedded information makes animated visualizations more accessible.
By Mac Slocum
October 20, 2011

An animated visualization from NASA shows how subtitles and simple narration can make complex graphics easier to understand. We need more of this.


1 to 50 of 552 Next

Popular Topics

Browse Books & Videos

International Sites

O'Reilly China O'Reilly Germany O'Reilly Japan