Securing Datanodes
Datanodes under Hadoop is traditionally secured by creating a Keytab file on the datanodes. With Ozone, we have moved away to using datanode certificates. That is, Kerberos on datanodes is not needed in case of a secure Ozone cluster.
However, we support the legacy Kerberos based Authentication to make it easy for the current set of users.The HDFS configuration keys are the following that is setup in hdfs-site.xml.
| Property | Description |
|---|---|
| dfs.datanode.kerberos.principal | The datanode service principal. e.g. dn/_HOST@REALM.COM |
| dfs.datanode.kerberos.keytab.file | The keytab file used by datanode daemon to login as its service principal. |
| hdds.datanode.http.auth.kerberos.principal | Datanode http server service principal. |
| hdds.datanode.http.auth.kerberos.keytab | The keytab file used by datanode http server to login as its service principal. |
How a datanode becomes secure.
Under Ozone, when a datanode boots up and discovers SCM’s address, the first thing that datanode does is to create a private key and send a certificate request to the SCM.
Certificate Approval via Kerberos Current Model
SCM has a built-in CA, and SCM has to approve this request. If the datanode already has a Kerberos key tab, then SCM will trust Kerberos credentials and issue a certificate automatically.Manual Approval In Progress
If these are brand new datanodes and Kerberos key tabs are not present at the datanodes, then this request for the datanodes identity certificate is queued up for approval from the administrator(This is work in progress, not committed in Ozone yet). In other words, the chain of trust is established by the administrator of the cluster.Automatic Approval In Progress
If you running under an container orchestrator like Kubernetes, we rely on Kubernetes to create a one-time token that will be given to datanode during boot time to prove the identity of the datanode container (This is also work in progress.)Once a certificate is issued, a datanode is secure and Ozone manager can issue block tokens. If there is no datanode certificates or the SCM’s root certificate is not present in the datanode, then datanode will register itself and download the SCM’s root certificate as well get the certificates for itself.
Next >>