Last updated: 2020-04-28 17:04:37PDF
The log search feature collects component operation logs and allows log search. You can search for core service logs of the current cluster and server system logs by keyword so as to quickly view key service logs without logging in to the server.
Log search supports filtering logs by current cluster, log file, server IP, and time range. A log result includes the server IP, absolute path of the log on the server, and log content.
Viewing Log Search
- Log in to the EMR Console and click Cluster Monitoring on the left sidebar.
- On the cluster monitoring page, select Log Search to filter and view log content by current cluster, log file, server IP, and time range.
View Context: during troubleshooting, you usually need to pay attention to contextual logs of keywords. On the log search result list page, you can select Operation > View Context to view contextual information of a log.
Service Types Supported by Log Search
- Currently, only logs in the last 15 days can be searched for.
- If log collection has not been enabled on your cluster, you can contact your Tencent Cloud rep for assistance.
Logs from the four components, namely, HDFS, YARN, Hive, and HBase, can be collected and stored in the following directories and files:
/data/emr/hdfs/logs: hadoop-hadoop.log hadoop-hadoop-namenode-. . . . hadoop-hadoop-datanode- . . . . /data/emr/yarn/logs: yarn-hadoop-resourcemanager- . . . . yarn-hadoop-resourcemanager- . . . .log yarn-hadoop-nodemanager- . . . . yarn-hadoop-nodemanager- . . . .log /data/emr/hive/logs: hadoop-hive hcat.err hcat. /data/emr/hbase/logs: hbase-hadoop-master- . . . . hbase-hadoop-master- . . . .log hbase-hadoop-regionserver- . . . . hbase-hadoop-regionserver- . . . .log