Skip to content

public-data-sets.md

Latest commit

 

History

History
48 lines (39 loc) · 5.74 KB

public-data-sets.md

File metadata and controls

48 lines (39 loc) · 5.74 KB
Raw
title Public data sets for Azure analytics
description Learn about public data sets that you can use to prototype and test Azure analytics services and solutions.
author VanMSFT
ms.author vanto
ms.reviewer mathoma
ms.date 10/01/2018
ms.service azure-sql-database
ms.subservice development
ms.topic reference
ms.custom sqldbrb=2

Public data sets for testing and prototyping

[!INCLUDEappliesto-sqldb-sqlmi-sqlvm]

Browse this list of public data sets for data that you can use to prototype and test storage and analytics services and solutions.

U.S. Government and agency data

Data source About the data About the files
US Government data Over 250,000 data sets covering agriculture, climate, consumer, ecosystems, education, energy, finance, health, local government, manufacturing, maritime, ocean, public safety, and science and research in the U.S. Files of various sizes in various formats including HTML, XML, CSV, JSON, Excel, and many others. You can filter available data sets by file format.
US Census data Statistical data about the population of the U.S. Data sets are in various formats.
Earth science data from NASA Over 32,000 data collections covering agriculture, atmosphere, biosphere, climate, cryosphere, human dimensions, hydrosphere, land surface, oceans, sun-earth interactions, and more. Data sets are in various formats.
Airline flight delays and other transportation data "The U.S. Department of Transportation's (DOT) Bureau of Transportation Statistics (BTS) tracks the on-time performance of domestic flights operated by large air carriers. Summary information on the number of on-time, delayed, canceled, and diverted flights appears ... in summary tables posted on this website." Files are in CSV format.
Traffic fatalities - US Fatality Analysis Reporting System (FARS) "FARS is a nationwide census providing NHTSA, Congress, and the American public yearly data regarding fatal injuries suffered in motor vehicle traffic crashes." "Create your own fatality data run online by using the FARS Query System. Or download all FARS data from 1975 to present from the FTP Site."
Toxic chemical data - EPA Toxicity ForeCaster (ToxCast™) data "EPA's most updated, publicly available high-throughput toxicity data on thousands of chemicals. This data is generated through the EPA's ToxCast research effort." Data sets are available in various formats including spreadsheets, R packages, and MySQL database files.
Biotechnology and genome data from the NCBI Multiple data sets covering genes, genomes, and proteins. Data sets are in text, XML, BLAST, and other formats. A BLAST app is available.

Other statistical and scientific data

Data source About the data About the files
New York City taxi data "Taxi trip records include fields capturing pick-up and dropoff dates/times, pick-up and dropoff locations, trip distances, itemized fares, rate types, payment types, and driver-reported passenger counts." Data sets are in CSV files by month.
Microsoft Research data sets - "Data Science for Research" Multiple data sets covering human-computer interaction, audio/video, data mining/information retrieval, geospatial/location, natural language processing, and robotics/computer vision. Data sets are in various formats, zipped for download.
Open Science Data Cloud data "The Open Science Data Cloud provides the scientific community with resources for storing, sharing, and analyzing terabyte and petabyte-scale scientific datasets." Data sets are in various formats.
Global climate data - WorldClim "WorldClim is a set of global climate layers (gridded climate data) with a spatial resolution of about 1 km2. These data can be used for mapping and spatial modeling." These files contain geospatial data.
Data about human society - The GDELT Project "The GDELT Project is the largest, most comprehensive, and highest resolution open database of human society ever created." The raw data files are in CSV format.
Advertising click prediction data for machine learning from Criteo "The largest ever publicly released ML dataset." For more info, see Criteo's 1 TB Click Prediction Dataset.

Online service data

Data source About the data About the files
GitHub archive "GitHub Archive is a project to record the public GitHub timeline [of events], archive it, and make it easily accessible for further analysis." Download JSON-encoded event archives in .gz (Gzip) format from a web client.
Stack Overflow data dump "This is an anonymized dump of all user-contributed content on the Stack Exchange network [including Stack Overflow]." "Each site [such as Stack Overflow] is formatted as a separate archive consisting of XML files zipped via 7-zip using bzip2 compression. Each site archive includes Posts, Users, Votes, Comments, PostHistory, and PostLinks."