Big Data Hadoop Expert Quiz

Posted on: | By: – Comments Off

Big Data Quiz

Big Data Quiz : This Big Data Expert Hadoop Quiz contains set of 60 Big Data Quiz which will help to clear any exam which is designed for Expert.



1) What is identity mapper in hadoop.

  1. When same mapper runs on the different dataset in same job.
  2. When same mapper runs on different dataset in different jobs.
  3. When there is no mapper for a job then identity mapper class used.
  4. Both b and c are correct.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
2) Default scheduler used in map-reducer framework

  1. Capacity scheduler.
  2. Fair scheduler.
  3. Job scheduler.
  4. Lazy scheduler.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
3) You are executing PIG in MapReduce mode and you want to execute in local mode. How can you achieve it?

  1. Pig –x local
  2. Pig –x mapreduce leave
  3. Both are correct
  4. None of these

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
4) The process in hadoop-2.0 which scale the name node horizontally is known as

  1. Federation
  2. Fenching
  3. Namenode HA
  4. None of these.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
5) What is true about partitioner in Map-reduce job?

  1. No. of partition is same as number of reducer.
  2. Default partition in hive is Hash partition.
  3. All of these.
  4. None of these.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
6) Which is not a role of reporter in map-reduce program.

  1. Report about the progress of mappers and reducers.
  2. Set application level status message.
  3. Update counters.
  4. Help in lunching failed job with the help of counter.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
7) What is mapred.tip.id refers to in the time of debugging?

  1. Id of the mapper currently running.
  2. Id of the reducer currently running.
  3. Id of the task currently running.
  4. Id of the job currently running.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
8) Which below scheduler support multiple queues?

  1. Fair scheduler
  2. Capacity scheduler.
  3. Lazy scheduler.
  4. Default scheduler.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
9) How can you set a debug script in hadoop MR Job?

  1. JobConf.setMapDebugScript(String)
  2. JobConf.setReducerDebugScript(String)
  3. JobConf.setJobScript(String)
  4. None of these.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
10) What is the default data type in PIG

  1. Bytearray
  2. Chararray
  3. Textarray
  4. None

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]



 
11) Which operator in PIG is not associated with loading and storing?

  1. Load
  2. Store
  3. Dump
  4. Split

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
12) How can you enable the MemStore-Local Allocation Buffer, a feature which works to prevent heap fragmentation under heavy write loads?

  1. hbase.hregion.memstore.mslab.enabled
  2. hbase.hregion.memstore.enabled
  3. hbase.hregion.memstore.mslab.job.enabled
  4. none

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
13) What is the hashing algorithm used for hash function.

  1. Murmur
  2. Lazy
  3. Default
  4. None.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
14) Which one is the policy configuration file used by RPC servers to make authorization decisions on client requests.

  1. hadoop.policy.file= hbase-policy.xml
  2. hadoop.policy.file.apache= hbase-policy.xml
  3. hadoop.policy.file.enable= hbase-policy.xml
  4. none

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
15) how can you specify destination directory in sqoop

  1. –target-dir <dir>
  2. –destination-dir <dir>
  3. –hdfs-dir <dir>
  4. All of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
16) How can you enable compression in sqoop.

  1. -z
  2. –compress
  3. Both a and b
  4. None.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
17) Let say you are importing from PostgreSQL through sqoop in conjunction with direct mode, you can split the import into separate files after individual files reach a certain size. How you can do it?

  1. –direct-split-size
  2. –input-split-size
  3. –postgresql-split-size
  4. None

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
18) What is the default port to access name node web UI?

  1. 50060
  2. 50050
  3. 50070
  4. None of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
19) How many states does Writable interface defines _____.

  1. Two
  2. Three
  3. Six
  4. None of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
20) What are supported programming languages for Map Reduce?

  1. The most common programming language is Java, but scripting languages are also supported via Hadoop streaming.
  2. Any programming language that can comply with Map Reduce concept can be supported.
  3. Only Java supported since Hadoop was written in Java.
  4. Currently Map Reduce supports Java, C, C++ and COBOL.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]



 
21) What is map – side join?

  1. Map-side join is a technique in which data is eliminated at the map step
  2. Map-side join is done in the map phase and done in memory
  3. Map-side join is a form of map-reduce API which joins data from different locations
  4. None of these answers are correct

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : B[/bg_collapse]
 
 
22) What is reduce – side join?

  1. Reduce-side join is a technique to eliminate data from initial data set at reduce step
  2. Reduce-side join is a technique for merging data from different sources based on a specific key. There are no memory restrictions
  3. Reduce-side join is a set of API to merge data from different sources.
  4. None of these answers are correct

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : B[/bg_collapse]
 
 
23) What is AVRO?

  1. Avro is a java serialization library
  2. Avro is a java compression library
  3. Avro is a java library that create splittable files
  4. None of these answers are correct

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : A[/bg_collapse]
 
 
24) Can you run Map – Reduce jobs directly on Avro data?

  1. Yes, Avro was specifically designed for data processing via Map-Reduce
  2. Yes, but additional extensive coding is required
  3. No, Avro was specifically designed for data storage only
  4. Avro specifies metadata that allows easier data access. This data cannot be used as part of map-reduce execution, rather input specification only.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : A[/bg_collapse]
 
 
25) Can a custom type for data Map-Reduce processing be implemented?

  1. No, Hadoop does not provide techniques for custom datatypes.
  2. Yes, but only for mappers.
  3. Yes, custom data types can be implemented as long as they implement writable interface.
  4. Yes, but only for reducers.

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : C[/bg_collapse]
 
 
26) Which Node acts as an access point for the external applications, tools, and users
that need to utilize the Hadoop environment.

  1. Datanode
  2. namenode
  3. job tracker
  4. N/A

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
27) Which object can be used to get the progress of a particular job

  1. MAP
  2. Reducer
  3. Context
  4. Prgress

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
28) Which node performs housekeeping functions for the NameNode.

  1. Datanode
  2. namenode
  3. Secondary NameNode
  4. Edge Node

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
29) Which of the following utilities allows you to create and run MapReduce jobs with any executable or script as the mapper and/or the reducer?

  1. Oozie
  2. Sqoop
  3. Sqoop
  4. Hadoop Streaming

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
30) Which MapReduce stage serves as a barrier, where all previous stages must be completed before it may proceed?

  1. Combine
  2. Group
  3. Reduce
  4. Write

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]



 
31) Which TACC resource has support for Hadoop MapReduce?

  1. Ranger
  2. Longhorn
  3. Lonestar
  4. Spur

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
32) What is the implementation language of the Hadoop MapReduce framework?

  1. Java
  2. C
  3. FORTRAN
  4. Python

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
33) Which MapReduce phase is theoretically able to utilize features of the underlying file system in order to optimize parallel execution?

  1. Split
  2. Map
  3. Combine
  4. None of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
34) _______ shell is used to execute Pig Latin statement

  1. Execute
  2. Run
  3. Grunt
  4. N/A

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
35) _______ operator is used to view logical, physical and mapreduce execution plan to compute a relation

  1. Show
  2. Describe
  3. Display
  4. Explain

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
36) Pig is developed by

  1. Face Book
  2. Yahoo
  3. Twitter
  4. Linked In

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
37) Pig is ?

  1. Declarative language
  2. Data Flow Language
  3. Both
  4. N/A

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
38) Following is not a Daemon of YARN

  1. Resource Manager
  2. Node Manager
  3. Application Master
  4. Job TRacker

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
39) What happens when a Map task crashes while running a MapReduce job on a cluster configured with MapReduce version 1 (MRv1)?

  1. The framework closes the JVM instance and restarts
  2. The job immediately fails
  3. The JobTracker attempts to re-run the task on the same node
  4. The JobTracker attempts to re-run the task on a different node

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
40) Which daemon reports available slots for scheduling a Map or Reduce operation in MapReduce version 1 (MRv1)?

  1. TaskTracker
  2. JobTracker
  3. Secondary NameNode
  4. DataNode

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]



 
41) How is the number of Mappers determined for a job in a MapReduce?

  1. The number of Mappers is calculated by the NameNode based on the number of HDFS blocks in the files.
  2. The developer specifies the number in the job configuration.
  3. The JobTracker chooses the number based on the number of available nodes.
  4. The number of Mappers is equal to the number of InputSplits calculated by the client submitting the job

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
42) Which daemon instantiates Java Virtual Machines in a cluster running MapReduce v1 (MRv1)

  1. ResourceManager
  2. TaskTracker
  3. JobTracker
  4. DataNode

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
43) Number of files the reduce task generate?

  1. one file all together
  2. one file per reducer
  3. Depends on input file
  4. None

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
44) If the Name node is down and job is submitted

  1. It will connect with Secondary name node to process the job
  2. Wait untill Name Node comes up
  3. gets files from local disk
  4. Job will fail

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
45) What is Partitioning in MapReduce

  1. Making map output into equal partions
  2. when map output exceeds the limit, create a new one
  3. Assigning map output keys to reducers
  4. None of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
46) The Reducer class defines

  1. How to process one key at a time
  2. How to process multiple keys together
  3. Depends on the logic any thing can be done
  4. Depends on the number of keys

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
47) By Default number of Map tasks depends upon

  1. number of machines
  2. Number of files
  3. configurable
  4. number of splits

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
48) How dose MapReduce hides data dispersion

  1. Through Map Reduce components
  2. By defining data as keys and values
  3. By clustering machines
  4. HDFS takes care of it

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
49) What is the input format for Hadoop Archive files

  1. TextInputFormat
  2. SequenceFileInputFormat
  3. None of these
  4. There is no suitable Input Format Type

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
50) map() method uses the following object to send output to Map/Reduce framework

  1. JobClient
  2. Config
  3. Context
  4. It can directly write

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]



 
51) Number of Partition is equals to

  1. Number of Reducers
  2. Number of Mappers
  3. Number of Input Split
  4. Number of output directories

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
52) A combiner class can be created by extending

  1. Combiner Class
  2. Mapper class
  3. Reducer Class
  4. Partitioner Class

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
53) Distributed cache can be used to add

  1. a data file
  2. a jar file library
  3. both 1 and 2
  4. None of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
54) For making Custom Partitioning one needs to implement

  1. Logic to be written in Mapper
  2. Logic to be written in Reducer
  3. Partitioner
  4. Combiner

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
55) _______________ file controls debugging metrics in hadoop

  1. .core-site.xml
  2. properties
  3. .hadoop-env.sh
  4. hadoop-metrics.properties

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : d[/bg_collapse]
 
 
56) Default input key type for TextInputFormat?

  1. LongWritable
  2. ShortWrtiable
  3. NullWritable
  4. Text

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : a[/bg_collapse]
 
 
57) Output of reducer is written to

  1. temp directory
  2. HDFS
  3. Local disk
  4. None of the above

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]
 
 
58) How to specify UNIX time in milliseconds in Flume.

  1. %u
  2. %b
  3. %t
  4. None

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : c[/bg_collapse]
 
 
59) How to specify long month name (January, February) in flume.\

  1. %b
  2. %B
  3. %M
  4. %l

[bg_collapse view=”button-green” color=”#FFF” icon=”arrow” expand_text=”Show Answer” collapse_text=”Hide Answer” ]Answer : b[/bg_collapse]


Related Articles

Advanced Manufacturing Process Quiz

Web analytics, Adobe Analytics, Google Analytics Quiz

SailPoint Quiz