Big Data/HDFS

< Big Data

Technologies

Distributed Files Sstem
- Google File System
- Apache HDFS
Distributed Programming
- MapReduce
- Apache Pig
- Apache Spark
- Apache Tez
NoSQL Databases
- Column Data Model
  - Google BigTable
  - Apache HBase
  - Hypertable
  - Amazon Dynamo
  - Apache Cassandra
  - Apache Accumulo
  - MonetDB
- Document Data Model
  - MongoDB
- Key-value Data Model
  - Redis DataBase
  - OpenTSDB
- Graph Data Model
  - Aurelius Titan Graph
- Data Grid
  - Hazelcast
NewSQL Databases
- Google Spanner
RDF Stores
- CumulusRDF
SQL-on-Hadoop
- Apache Hive
- Google Dremel
- Apache Drill
- Cloudera Impala
- Apache Spark SQL
- AMPLAB Shark
Service Programming
- Apache YARN
- Apache Thrift
- Apache Zookeeper
Stream Processing
- Apache Storm
- Apache S4
- Apache Spark Streaming
- Google MillWheel
Graph Processing
- Google Pregel
- Apache Giraph
- Apache Spark GraphX

Hadoop Distributed File System (HDFS) is a distributed file system. It is part of Apache Hadoop.

Related Technologies

Google File System - served as a model for HDFS

References

Hadoop Distributed File System - documentation
Wikipedia Article - Hadoop Distributed File System
K. Shvachko and H. Kuang and S. Radia and R. Chansler "The Hadoop Distributed File System" Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST '10), 2010, Pages 1-10, IEEE Computer Society Washington, DC, USA