Datasets

MARKETING

• Online/Catalog Marketing

• Cross-Selling

• NetFlix

• Direct Marketing

• COIL Insurance Customer Data

  • comScore: online users and purchases. Yong has the data.

DEMOGRAPHIC, CENSUS & STATISTICS

• • FedStats: a comprehensive source of US statistics and more

• United States Census Bureau.

• Statistical Sites on the World Wide Web

• DISC-UK Data

  • DataFerrett, a data mining tool that accesses and manipulates TheDataWeb, a collection of many on-line US Goverment datasets.

  • AI-D (AI for Development)

GENERAL DATA MINING & MACHINE LEARNING

• UCI KDD Database Repository

• UCI Machine Learning Repository.

  • DELVE: collection of data for developing, evaluating, and comparing learning methods

  • FIMI: frequent itemset mining implementations repository, containing software and datasets

  • http://www.csse.monash.edu.au/~dld/datalinks.html

• Agnostic Learning vs Prior Knowledge

  • TATOO1 and TATOO2

  • Artificial Intelligent for Development

  • Visualize Free, with wonder full visualization of real-world datasets

TEXT MINING & NATURAL LANGUAGE PROCESSING

• TREC

  • CORA at UMass, provided by Andrew McCallum

• Enron Email Data Set

  • 911 Pager Data: includes 50M text messages covering 24 hour period surrounding the September 11, 2001.

  • AOL Search Data Scandal (mirror sites listed)

• Internet User Queries (KDD Cup 2005)

• Web Search Click Data (WSCD 2009 Workshop)

• Online Retailer Website Clickstream Analysis

• Yahoo Webscope : Yong, Wenjun, & Zhongmou have requested selected datasets

SOCIAL NETWORK

• Trust Network

• Facebook APIs

• Twitter APIs

• OpenSocial.org APIs

  • Amazon Web Services (AWS) Public Data Sets, a centralized repository of public data sets that can be seamlessly integrated into AWS cloud-based applications.

GRAPH & NETWORK

• Graph Datasets

• Wireless Data Repository

• Computer Network Intrusion Detection

• SourceForge.net Research Data

TIME SERIES

• UCR Time Series Classification/Clustering Data

  • Artificial Neural Network and Computational Intelligence Time Series Forecasting Competitions

    • NNCG1: the 2009-2010 competition on transportation data

    • NN5: the 2008 competition on cash money withdrawals at cash-machines

    • NN3: the 2006-2007 competition on empirical business time series

FINANCIAL

• Financial Data Finder at OSU

• Investor Links

• Yahoo Finance

• Grain Market Research

• Factiva

  • WRDS: Wharton B-Sh financial database, subscription required, ask mqf for access.

MULTIMEDIA & SPATIAL

• Microsoft's TerraServer

• National Space Science Data Center

• Particle Physics, Protein Homology

• GIS Datasets

• MERL (WMD 2007)

• Pulmonary Embolisms Detection from Image Data

• MIT Reality

  • MIT data from Xiaogang Wang: Yong has the complete data.

  • R-Portal: having some GPS traces of buses and trucks in Greece.

BIOINFOMATICS

• GeneSifter Data Center

• Gene Expression Omnibus (GEO)

• MIT Cancer Genomics

• PubGene

• Stanford Microarray Database (SMD)

• BioMed Documents, Gene Role Classification

• Molecular Bioactivity, Protein Locale Prediction