Network Ports

This document provides a comprehensive overview of the network ports utilized by Apache Ozone. Due to its distributed nature and the requirement for high performance in handling data-intensive tasks, understanding and correctly configuring these network ports is essential for the successful deployment, operation, and maintenance of Apache Ozone clusters.

Ozone Manager (OM)

Default Port Number Configuration Key Endpoint Protocol Purpose
9862 ozone.om.address.<service_id>.<node_id> Hadoop RPC Primary RPC endpoint for Ozone clients
9874 ozone.om.http-address.<service_id>.<node_id> HTTP Web UI for monitoring OM status and metadata
9875 ozone.om.https-address.<service_id>.<node_id> HTTPS Secure Web UI for monitoring OM status and metadata
9872 ozone.om.ratis.port.<service_id>.<node_id> HTTP/2 RPC endpoint for OM HA instances to form a RAFT consensus ring
8981 ozone.om.grpc.port HTTP/2 gRPC endpoint for Ozone Manager clients

Note: except for ozone.om.grpc.port, all the above OM properties are suffixed with service_id.node_id. For example: ozone.om.address.cluster1.om1.

Storage Container Manager (SCM)

Default Port Number Configuration Key Endpoint Protocol Purpose
9860 ozone.scm.client.port.<service_id>.<node_id> Hadoop RPC Communication with Ozone clients for namespace and container management. ozone.scm.client.address overrides it, if defined (default is empty)
9863 ozone.scm.block.client.port.<service_id>.<node_id> Hadoop RPC Communication with Datanodes for block-level operations
9861 ozone.scm.datanode.port.<service_id>.<node_id> Hadoop RPC Port used by Datanodes to communicate with the SCM. ozone.scm.datanode.address overrides it, if defined (default is empty)
9961 ozone.scm.security.service.port.<service_id>.<node_id> Hadoop RPC SCM security server port
9876 ozone.scm.http-address.<service_id>.<node_id> HTTP Web UI for monitoring SCM status
9877 ozone.scm.https-address.<service_id>.<node_id> HTTPS Secure Web UI for monitoring SCM status
9894 ozone.scm.ratis.port.<service_id>.<node_id> HTTP/2 SCM Ratis HA
9895 ozone.scm.grpc.port.<service_id>.<node_id> HTTP/2 SCM GRPC server port

Note: all the above SCM properties are suffixed with service_id.node_id. For example: ozone.scm.client.port.scmservice.scm1.

Recon

Default Port Number Configuration Key Endpoint Protocol Purpose
9891 ozone.recon.address Hadoop RPC RPC address for Recon to collect metadata from other Ozone services
9888 ozone.recon.http-address HTTP Web-based management and monitoring console for the entire Ozone cluster
9889 ozone.recon.https-address HTTPS Web-based management and monitoring console for the entire Ozone cluster

S3 Gateway (S3G)

Default Port Number Configuration Key Endpoint Protocol Purpose
9878 ozone.s3g.http-address HTTP S3-compatible RESTful API endpoint
9879 ozone.s3g.https-address HTTPS Secure S3-compatible RESTful API endpoint
19878 ozone.s3g.webadmin.http-address HTTP Ozone S3Gateway serves web content
19879 ozone.s3g.webadmin.https-address HTTPS Ozone S3Gateway serves web content

HttpFS Server

Default Port Number Configuration Key Endpoint Protocol Purpose
14000 httpfs.http.port HTTP or HTTPS The HTTP port for HttpFS REST API. TLS is enabled if httpfs.ssl.enabled is true

Datanode

Default Port Number Configuration Key Endpoint Protocol Purpose
9859 hdds.container.ipc.port HTTP/2 Inter-process communication related to container operations
9855 hdds.container.ratis.datastream.port TCP Ratis data streaming for container replication (if enabled)
9858 hdds.container.ratis.ipc.port HTTP/2 Communication with embedded Ratis server for replication coordination
9857 hdds.container.ratis.admin.port HTTP/2 Administrative requests to the Ratis server
9856 hdds.container.ratis.server.port HTTP/2 Communication between Ratis peers in a replication pipeline
9882 hdds.datanode.http-address HTTP Web UI for monitoring Datanode status and resource utilization
9883 hdds.datanode.https-address HTTPS Secure Web UI for monitoring Datanode status and resource utilization
19864 hdds.datanode.client.port Hadoop RPC The port number of the Ozone Datanode client service

Note:

  • The default port values can be overridden within the ozone-site.xml configuration file, with the exception of Httpfs ports, which are configurable via the httpfs-site.xml configuration file.
  • Hadoop RPC, a binary protocol operating over TCP, may be authenticated and encrypted using the Java SASL mechanism.
  • Authentication of the Web UI and HttpFS is achievable through Kerberos/SPNEGO, with encryption facilitated by HTTPS.
  • S3 client connections to the S3 Gateway undergo authentication utilizing S3 secrets and encryption via TLS.
  • A series of Ozone service ports are established by gRPC and Ratis, the latter employing gRPC. gRPC, a protocol based on HTTP/2, is capable of being encrypted with TLS.
  • Ratis streaming ports, initiated by Netty, can be secured through TLS encryption.