Docker-Hub sample

In this samples, we are running in parallel a set of tasks. Each task is bound to a different Linux distribution.

To run the following sample rename samples.conf.example to samples.conf and edit with your own authentication token.

  • samples.conf

# This is your secret token, keep it safe

A large set of pre-built Docker containers are available on DockerHub

#!/usr/bin/env python
import sys
import qarnot
import os
import operator

# Edit 'samples.conf' to provide your own credentials
# Create a connection, from which all other objects will be derived
conn = qarnot.Connection('samples.conf')

# A set of linux distributions that could be found on
# Each distribution is started in a different task. All the tasks are running in parallel
linux_versions = ["library/centos:5",      \
                  "library/centos:6",      \
                  "library/ubuntu:14.04",  \
                  "library/ubuntu:16.04",  \
                  "library/debian:jessie", \
                  "library/opensuse:42.1", \
# Create the tasks
tasks = {i: conn.create_task('sample3-dockerhub-%s' % i, 'docker-batch', 1) for i in linux_versions}

# Store if an error happened during the process
error_happened = False
    # Set the command to run when launching the container, by overriding a
    # constant.
    # Task constants are the main way of controlling a task's behaviour
    for version,task in tasks.items():
        (repo,tag) = version.split(':')
        task.constants['DOCKER_REPO'] = repo
        task.constants['DOCKER_TAG'] = tag
        task.constants['DOCKER_CMD'] = 'sh -c "cat /etc/issue | head -n 1"'
        print("** Submitting %s..." %
        # Submit the task to the Api, that will launch it on the cluster

    # Wait for the task to be finished, and monitor the progress of its
    # deployment
    last_state = { '' for task in tasks.values()}
    done = False
    while not done:
        for task in tasks.values():
            if task.state != last_state[]:
                last_state[] = task.state
                print("** {} >>> {}".format(, last_state[]))
        # Wait for the task to complete, with a timeout of 2 seconds.
        # This will return True as soon as the task is complete, or False
        # after the timeout.        
        done = all([task.wait(2) for task in tasks.values()])
        # Display fresh stdout / stderr
        map(sys.stdout.write, [task.fresh_stdout() for task in tasks.values()])
        map(sys.stderr.write, [task.fresh_stderr() for task in tasks.values()])
    # Display errors on failure
    for task in tasks.values():
        if task.state == 'Failure':
            print("** %s >>> Errors: %s" % (, task.errors[0]))
            error_happened = True

    for task in tasks.values():
        task.delete(purge_resources=True, purge_results=True)

    # Exit code in case of error
    if error_happened:
  • Run the sample

This sample is available on Github.

Next steps