Container-to-Container Networking

Table of Contents

App developers can leverage cloud.gov’s container-to-container networking feature to allow direct communication between their applications. This utilizes Cloud Foundry’s overlay network, which is not externally routable. Any traffic sent between containers on this network does not leave the overlay.

How to set up container-to-container networking

To set up and allow traffic between your applications:

1. Create an internal route to your application(s)

   cf map-route APP apps.internal --hostname APP
   

2. Add a network policy to allow traffic from one application to another

   cf add-network-policy SOURCE_APP DESTINATION_APP -s DESTINATION_SPACE_NAME -o DESTINATION_ORG_NAME --protocol (tcp | udp) --port RANGE
   

Configuring secure container-to-container networking

There are two main ways to enable TLS between your application:

• Automatically - With this option the platform handles everything, from provisioning certificates to enforcing TLS termination at the destination (steps described below)
• Manually - This option is necessary if you want to listen on multiple or non-configurable ports. With this option, you are responsible for configuring your application with its own TLS termination and managing TLS certificates. The steps to enable this option depend on the application(s) you’re running, and are out of scope for this documentation.

To set up automatic encryption:

1. Create a network policy for your destination application and set the port to 61443. All traffic sent to this port will use SSL/TLS

   cf add-network-policy SOURCE_APP DESTINATION_APP -s DESTINATION_SPACE_NAME -o DESTINATION_ORG_NAME --protocol tcp --port 61443
   

2. Update your source application to send all traffic to the destination application on port 61443.

For more information you can check out the Cloud Foundry documentation on Securing Container-to-Container Traffic

Addressing certificate validation errors

Regarding container-to-container networking and certificate validation: some code libraries may import their own certificate stores, overriding certificates that cloud.gov provides and preventing applications from being able to validate TLS connections. If your application runs into certificate validation errors, you may need to set the certificate store locations by configuring the library or by setting environment variables to point to the system certificate store. All the certificates for a buildpack based system on cloudfoundry are stored in /etc/ssl/certs and the correct CA authority is stored in /etc/ssl/certs/ca-certificates.crt

For example: The Python Requests library depends upon the Certifi library which installs its own CA certificate file, thus breaking container to container TLS CA validation.

To fix this, you can modify two environment variables and require the system CA cert stores are used by Python OpenSSL and Requests as shown below:

SSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crt

REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt