Big Data Testing: Functional & Performance




Big Data Testing   What is Big Data? Big data is a collection of large datasets that cannot be processed using traditional computing techniques. Testing of these datasets involves various tools, techniques and frameworks to process. Big data relates to data creation, storage, retrieval and analysis that is remarkable in terms of volume, variety, and velocity. You can learn more […]

Read more

What is Hadoop Sqoop? What is FLUME – Hadoop Tutorial




What is Hadoop Sqoop? What is FLUME – Hadoop Tutorial In this Article we are going to learn hadoop sqoop and hadoop flume. Before we learn more about Flume and Sqoop , lets study Issues with Data Load into Hadoop Analytical processing using Hadoop requires loading of huge amounts of data from diverse sources into Hadoop clusters. This process of […]

Read more

hadoop Sqoop vs Flume vs HDFS in Hadoop




Sqoop vs Flume vs HDFS in Hadoop Please see the below table section for the difference between hadoop Sqoop vs Flume Vs HDFS. Hadoop Sqoop Flume  HDFS Hadoop Sqoop is used for importing data from structured data sources such as RDBMS. Flume is used for moving bulk streaming data into HDFS. HDFS is a distributed file system used by Hadoop […]

Read more

Hadoop – HDFS Operations




Hadoop – HDFS Operations   we will see in this article about HDFS Operations that we usually needs for our job. Starting HDFS Initially you have to format the configured HDFS file system, open namenode (HDFS server), and execute the following command. $ hadoop namenode -format After formatting the HDFS, start the distributed file system. The following command will start […]

Read more

Hadoop Commands Reference




Hadoop Commands Reference There are many more commands in “$HADOOP_HOME/bin/hadoop fs”than are demonstrated here, although these basic operations will get you started. Running ./bin/hadoop dfs with no additional arguments will list all the commands that can be run with the FsShell system. Furthermore, $HADOOP_HOME/bin/hadoop fs -help commandName will display a short usage summary for the operation in question, if you […]

Read more