Evolution of Data Management in Enterprise-from File System to Data Lakes
DOI:
https://doi.org/10.63282/3117-5481/AIJCST-V1I5P103Keywords:
RDBMS, Dataware House, Data Lake, No SQL, Search Based IndexAbstract
This paper will capture the evolution of high-level technical overview of the data technologies progressed from legacy file system to refined data stores adhering to specialized use cases that include managing both structured and unstructured data (including images, text, documents etc.). It starts with a brief overview of the data technologies that evolved over time and finally analyzes the strength and weakness with best fit use case. Overall, it covers the evolution with a detailed progression and uses comparative approach for real life use cases.
References
[1] E. F. Codd, “A Relational Model of Data for Large Shared Data Banks,” Communications of the ACM, 1970.References
[2] Codd’s 12 rules
[3] Ralph Kimball “White Paper: An Architecture for Data Quality “
[4] Kevin D. Foote A Brief History of Non-Relational Databases
[5] Apache Lucene features
[6] "Pentaho, Hadoop, and Data Lakes," James Dixon's Blog, 14 October 2010
