Network Ports
This document provides a comprehensive overview of the network ports utilized by Apache Ozone. Due to its distributed nature and the requirement for high performance in handling data-intensive tasks, understanding and correctly configuring these network ports is essential for the successful deployment, operation, and maintenance of Apache Ozone clusters.
Ozone Manager (OM)
| Default Port Number |
Configuration Key |
Endpoint Protocol |
Purpose |
| 9862 |
ozone.om.address.<service_id>.<node_id> |
Hadoop RPC |
Primary RPC endpoint for Ozone clients |
| 9874 |
ozone.om.http-address.<service_id>.<node_id> |
HTTP |
Web UI for monitoring OM status and metadata |
| 9875 |
ozone.om.https-address.<service_id>.<node_id> |
HTTPS |
Secure Web UI for monitoring OM status and metadata |
| 9872 |
ozone.om.ratis.port.<service_id>.<node_id> |
HTTP/2 |
RPC endpoint for OM HA instances to form a RAFT consensus ring |
| 8981 |
ozone.om.grpc.port |
HTTP/2 |
gRPC endpoint for Ozone Manager clients |
Note: except for ozone.om.grpc.port, all the above OM properties are suffixed with service_id.node_id.
For example: ozone.om.address.cluster1.om1.
Storage Container Manager (SCM)
| Default Port Number |
Configuration Key |
Endpoint Protocol |
Purpose |
| 9860 |
ozone.scm.client.port.<service_id>.<node_id> |
Hadoop RPC |
Communication with Ozone clients for namespace and container management. ozone.scm.client.address overrides it, if defined (default is empty) |
| 9863 |
ozone.scm.block.client.port.<service_id>.<node_id> |
Hadoop RPC |
Communication with Datanodes for block-level operations |
| 9861 |
ozone.scm.datanode.port.<service_id>.<node_id> |
Hadoop RPC |
Port used by Datanodes to communicate with the SCM. ozone.scm.datanode.address overrides it, if defined (default is empty) |
| 9961 |
ozone.scm.security.service.port.<service_id>.<node_id> |
Hadoop RPC |
SCM security server port |
| 9876 |
ozone.scm.http-address.<service_id>.<node_id> |
HTTP |
Web UI for monitoring SCM status |
| 9877 |
ozone.scm.https-address.<service_id>.<node_id> |
HTTPS |
Secure Web UI for monitoring SCM status |
| 9894 |
ozone.scm.ratis.port.<service_id>.<node_id> |
HTTP/2 |
SCM Ratis HA |
| 9895 |
ozone.scm.grpc.port.<service_id>.<node_id> |
HTTP/2 |
SCM GRPC server port |
Note: all the above SCM properties are suffixed with service_id.node_id.
For example: ozone.scm.client.port.scmservice.scm1.
Recon
| Default Port Number |
Configuration Key |
Endpoint Protocol |
Purpose |
| 9891 |
ozone.recon.address |
Hadoop RPC |
RPC address for Recon to collect metadata from other Ozone services |
| 9888 |
ozone.recon.http-address |
HTTP |
Web-based management and monitoring console for the entire Ozone cluster |
| 9889 |
ozone.recon.https-address |
HTTPS |
Web-based management and monitoring console for the entire Ozone cluster |
S3 Gateway (S3G)
| Default Port Number |
Configuration Key |
Endpoint Protocol |
Purpose |
| 9878 |
ozone.s3g.http-address |
HTTP |
S3-compatible RESTful API endpoint |
| 9879 |
ozone.s3g.https-address |
HTTPS |
Secure S3-compatible RESTful API endpoint |
| 19878 |
ozone.s3g.webadmin.http-address |
HTTP |
Ozone S3Gateway serves web content |
| 19879 |
ozone.s3g.webadmin.https-address |
HTTPS |
Ozone S3Gateway serves web content |
HttpFS Server
| Default Port Number |
Configuration Key |
Endpoint Protocol |
Purpose |
| 14000 |
httpfs.http.port |
HTTP or HTTPS |
The HTTP port for HttpFS REST API. TLS is enabled if httpfs.ssl.enabled is true |
Datanode
| Default Port Number |
Configuration Key |
Endpoint Protocol |
Purpose |
| 9859 |
hdds.container.ipc.port |
HTTP/2 |
Inter-process communication related to container operations |
| 9855 |
hdds.container.ratis.datastream.port |
TCP |
Ratis data streaming for container replication (if enabled) |
| 9858 |
hdds.container.ratis.ipc.port |
HTTP/2 |
Communication with embedded Ratis server for replication coordination |
| 9857 |
hdds.container.ratis.admin.port |
HTTP/2 |
Administrative requests to the Ratis server |
| 9856 |
hdds.container.ratis.server.port |
HTTP/2 |
Communication between Ratis peers in a replication pipeline |
| 9882 |
hdds.datanode.http-address |
HTTP |
Web UI for monitoring Datanode status and resource utilization |
| 9883 |
hdds.datanode.https-address |
HTTPS |
Secure Web UI for monitoring Datanode status and resource utilization |
| 19864 |
hdds.datanode.client.port |
Hadoop RPC |
The port number of the Ozone Datanode client service |
Note:
- The default port values can be overridden within the
ozone-site.xml configuration file, with the exception of Httpfs ports, which are configurable via the httpfs-site.xml configuration file.
- Hadoop RPC, a binary protocol operating over TCP, may be authenticated and encrypted using the Java SASL mechanism.
- Authentication of the Web UI and HttpFS is achievable through Kerberos/SPNEGO, with encryption facilitated by HTTPS.
- S3 client connections to the S3 Gateway undergo authentication utilizing S3 secrets and encryption via TLS.
- A series of Ozone service ports are established by gRPC and Ratis, the latter employing gRPC. gRPC, a protocol based on HTTP/2, is capable of being encrypted with TLS.
- Ratis streaming ports, initiated by Netty, can be secured through TLS encryption.
Next >>