HDFS - DataShark Academy

Home > HDFS

Why Large number of files on Hadoop is a problem and how to fix it?

This post may contain affiliate links. Please read our disclosure for more info.

There are multiple reasons for large number of files on Hadoop. Hadoop has its own file system to store data in form of files;...

How to find bad partitions in hive table

How to find bad partitions in a huge HIVE table

This post may contain affiliate links. Please read our disclosure for more info.

Recently we found an issue with use of ANALYZE table queries inside Hive, where analyze command was changing ‘LOCATION’ property of random partitions in...