H13-723_V2.0 HCIP-Big Data Developer V2.0 Questions and Answers

True

False

Support based onRESTquery request

WebHCatThe return data format isSML

WebHCatbased onHTTPandHTTPSAgreement to provide services to the outside world

able to passWebHCatCreate tables, query, etc.

RequirePythonversion no lower than2.6.6,not higher than2.7.0

Client must havesetuptools, and the version is not lower than5.0

hive_python_clientscript provides direct executionSQLfunctions, such ashive_python_client'show tables'

PythonSecondary development does not support secure clusters

True

False

lines.flatMap(_.split??)).map(word=>(word,1)).reduce(_+_).print ( )

lines.flatMap(_.split??)).map(word=>(word,word.length())).reduceByKey(_+_).print ( )

lines.flatMap(_.split??)).map(word=>(word,1)).reduceByKey(_+_).print ( )

lines.flatMap(_.split??)).flatmap(word=>(word,1)).groupByKey(_+_).print ( )

When the client initiates a scan request, it willscan cachingset too large

Initiate by client-specified methodFlushdo

RegionServerTotal memory exceeds threshold

RegionofMemStoreset over threshold

Partition fields are defined when the table is created

There can only be one partition field, and multi-level partitions cannot be created

Using partitions can reduce the data scan range of some queries, thereby improving query efficiency

Partition fields can be used aswherecondition of the sentence

pre-scoreregion,MakeregionEvenly distributed, improve concurrency

Query frequent attributes are placed inrowkeyThe front part

Use secondary indexes to adapt to more query scenarios

Data read at the same time are stored in the samecellmiddle

NodeManager

Resource Manager

Data Node

NameNode

Put

HTable

HBaseAdmin

PutList

128M

100M

64M

50M

Partition Table

bucket table

Tilt table

partition+bucket table

True

False

hdfs fsck /test.txt–files

hdfs fsck /text.txt–locations

hdfs fsck /test.txt–blocks

hdfs fsck /test.txt–list–corruptfileblocks

Table Name

table names and columns

Table names and column families

can be empty

JDB, C

spark-beeline

spark-sql

mapandcombine

reduceandcombine

combineandsort

mapandreduce

True

False

mergemapThe result of the stage has the samekeyvalue key-value pair

put allmapThe results of the stages are merged to get the final result

rightmapThe results of the stages are sorted and merged

Split the input data into individualsplit, and willsplitfurther split intoyes, then asmapletter

input of numbers

Mass data storage

Lots of small file storage

large file storage

Streaming file storage

submitcommand to change the status of the job toPREP

startcommand allowsPREPThe status of the job changes toRUNNING

runcommand to change the job status toRUNNING

killCommands can act onPREP/SUSPEND/RUNNINGstatus job

Versions

TTL

Coprocessor

Compression

SupervisorAfter the process exits, it can beNimbusAutomatically identify and pull up without affecting the running business

WorkerCan be used after abnormal exitsupervisorsPulls up automatically without manual intervention

When a node fails, the tasks on the node will be reassigned to other normal nodes without manual intervention

NimbusAfter the failure, the backupNimbusIt will take over automatically without affecting the running business

Create an index on solr, save the data, and return all the data during full-text search

Store data on HBase, and satisfy fuzzy matching queries through HBase's filtering feature

When storing data, build an index on solr, and store complete data in HBase: query full text through solr

Retrieve the key information of the record, and obtain the complete record on HBase through the key information

1

2

3

4

Storm.jar example.jar wcTest om.huawei..example.wordcount

Storm.jar example.jar wcTest wordcount

Storm.jar example.jar om.huawei..example.wordcount wcTest

Storm.jar example.jar wordcount wcTest

krb5.confconfiguration file

existFusionInsight ManagerUser account applied on

user accountkeytabdocument

jaas.confconfiguration file

stream processing

high performance

Scalable

High fault tolerance

True

False

Bucket table, bucket according to day

Partition table, partitioned by day

skew table, skew field select date, skew value random

partition+Bucket table, partitioned by time, each partition2560buckets

True

False

HIVE

HBASE

HDFS

DB

Name+Phone number

date+Phone number

Phone number+date

Phone number+Name

OneTopologyis made up of a group ofSpoutcomponents andBoltcomponents passStream GroupingsA connected directed acyclic graph

(DAG)

Topologywill run until it is explicitlykill

Business logic is encapsulatedTopologymiddle

OneTopologyOnly one can be specified to startWorkerprocess

to emit

execute

open

nextTuple

True

False

True

False

HIVE

HBASE

HDFS

DB

True

False

pre-scoreregion,MakeregionEvenly distributed, improve concurrency

Query frequent attributes are placed inrowkeyThe front part

Use secondary indexes to adapt to more query scenarios

Data read at the same time are stored in the samecellmiddle

HFile

HLog

MemStore

HMaster

Attribute values with high access weight are placed inRowKeyFront

Attribute values with high access weight are placed inRowkeysecond half

Attribute values with good dispersion are placed inRowkeyfirst half

Attribute values with good dispersion are placed inRowkeysecond half

lines.flatMap(_.split(" ")).map(word =>(word,1)).reduce(_+_).print( )

lines.flatMap(_.split(" ")).map(word =>(word,word.length())).reduceByKey

(_+_).print( )

lines.flatMap(_.split(" ")).map(word =>(word,1)).reduceByKey(_+_).print

( )

lines.flatMap(_.split(" ")).flatmap(word =>(word,1)).groupByKey(_+_).print

( )

krb5.confconfiguration file

existFusionInsight ManagerUser account applied on

user accountkeytabdocument

jaas.confconfiguration file

zKFC(ZKFalovercontroler)as aZoKeeperCluster client for monitoringNameNode

status information.

zkFCprocess hopeNameNodenode andZoKeeperofLeaderdeployed in the node.

//(ZKFCProcess is only deployingNameNodeexists in the node)

standbyameodepassZokceperKnow moreAcibe Nameodestate, onceAeametoesmachine,Standby

NameNodeThe primary operation will be performed.

HdFSNameoofCConnected to2Ke4Pf, save the hostname and other information tozoKe-p%rmiddle

sent in order.

True

False

mouthJDB, Cinterface

mouthODB, Cinterface

mouthPythoninterface

mouthRubyinterface

The client caches the topology information of the cluster.

The server caches the topology information of the cluster

both are

neither

Build queuing systems, such as message queues

Port uniq operations, such as getting the ranking value of all data in a certain period of time

Get the latest N data operations: for example, get the latest 10 comments on a Weibo

simulating stack operations

INCR(increment the stored digital value by one)

HINCRBY(for the hash tablekeydomain infieldvalue plus incrementincrement)

LPUSH(for linked listspushoperate)

All of the above

Click Tree under Cloud to view metadata such as Collections, configuration sets, and ive nodes in Solr loud information

Click Cloud to view the Replica distribution and status of each Shard under each Collection

Enter the Core Oveview interface where Calectiopeyshard Replicaf is installed, and you can view the Replca index Real Qunwen You Department relies on storing size and location information

Users of the Sor user group, Solr admin role, and Super group can access the Solr Admin UI

requires fullA, CIDFeature application scenarios

Mass data application scenarios

High throughput application scenarios

Semi-structured data application scenarios

Put

HTable

HBaseAdmin

Puttist

NodeManager

ResourceManager

DataNode

NameNode

mouth viewOozieofJava APIWhether the returned result is as expected

mouth throughHueofworkflowDashboard to view program running results

mouth throughHue's file browser to see ifHDFSThe specified directory produces the expected file

mouthOozieself-containedWebThe interface can also view the job execution results

True

False

True

False

True

False

True

False

Attribute values with high access weight are placed inRowKeyFront

Attribute values with high access weight are placed inRowkeysecond half

Attribute values with good dispersion are placed inRowkeyfirst half

Attribute values with good dispersion are placed inRowkeysecond half

True

False

compromise method (rowkeyDesign takes into accountAandBbusiness needs)

Redundancy method (use space for time factory efficiency)

Create secondary index

pre-scoreregion

hive.exec.compress.intermediate (middle)

hive.intermediate.compression.codec

hive.exec.compress.output

hive.intermediate.compression.type

True

False

5

10

20

30

submitcommand to change the status of the job toPREP

startcommand allowsPREPThe status of the job changes toRUNNING

runcommand to change the job status toRUNNING

killCommands can act onPREP/SUSPEND/RUNNINGstatus job

broadcast variable in eachTasksave a copy

broadcast variable in eachExecutorsave a copy

Broadcast variables are read-only

broadcast variable viaSparkContext.broadcast) method to generate

Attribute values with high access weight are placed inRowKeyFront

Attribute values with high access weight are placed inRowkeysecond half

Attribute values with good dispersion are placed inRowkeyfirst half

Attribute values with good dispersion are placed inRowkeysecond half

Shuffle Grouping

Field Grouping

Local Grouping

Direct Grouping

True

False

True

False

Once the table is created, the table name cannot be changed.

Once the table is created, the column names cannot be changed.

Once the table is created, no new columns can be added.

1

2

3

4

Active and standbyNameNodeof metadata is running out of disk space.

The number of missing blocks exceeds the threshold.

Lost replicas exceed the threshold.

The corrupted copy exceeds the threshold.

Both are available externallySQLor classSQLability

Both can run onMapReduceon the computational framework

Both are available via table fields andHBaseAccess by field mappingHBasedata on

Both can run onSparkon the computational framework