The log search feature collects component operation logs and allows log search. You can search for core service logs of the current cluster and node system logs by keyword so as to quickly view key service logs without logging in to the node.
Log search supports filtering logs by current cluster, log file, node IP, and time range. A log result includes the node IP, absolute path of the log on the node, and log content.
View Context: during troubleshooting, you usually need to pay attention to contextual logs of keywords. On the log search result list page, you can select Operation > View Context to view contextual information of a log.
- Currently, only logs in the last 15 days can be searched for.
- If log collection has not been enabled on your cluster, you can contact your Tencent Cloud rep for assistance.
Logs from the four components, namely, HDFS, YARN, Hive, and HBase, can be collected and stored in the following directories and files:
/data/emr/hdfs/logs: hadoop-hadoop.log hadoop-hadoop-namenode-. . . . hadoop-hadoop-datanode- . . . . /data/emr/yarn/logs: yarn-hadoop-resourcemanager- . . . . yarn-hadoop-resourcemanager- . . . .log yarn-hadoop-nodemanager- . . . . yarn-hadoop-nodemanager- . . . .log /data/emr/hive/logs: hadoop-hive hcat.err hcat. /data/emr/hbase/logs: hbase-hadoop-master- . . . . hbase-hadoop-master- . . . .log hbase-hadoop-regionserver- . . . . hbase-hadoop-regionserver- . . . .log