Using pre-built Docker images 

The Dockerfiles to regenerate them are located in ./docker/bigtop-slaves.

docker run --rm -t -i -v `pwd`:/ws bigtop/slaves:1.1.0-ubuntu-16.04-aarch64 /bin/bash

sudo docker run -u jenkins --rm -v `pwd`:/ws$DOCKER_SELINUX --workdir /ws  bigtop/slaves:trunk-ubuntu-16.04 bash -l -c '. /etc/profile.d/bigtop.sh; ./gradlew allclean all'

sudo docker run -u jenkins --rm -v `pwd`:/ws$DOCKER_SELINUX --workdir /ws -e COMPONENTS=$COMPONENTS  -e CONFIGURE_NEXUS=$CONFIGURE_NEXUS $NEXUS  bigtop/slaves:trunk-ubuntu-16.04 bash -c '. /etc/profile.d/bigtop.sh; ./gradlew allclean $CONFIGURE_NEXUS $COMPONENTS-pkg'

The Job Bigtop-1.1.0 to create a repository is essentially:

#!/bin/bash -ex
 
# Workaround for wrong distributions (sic! ppc64el !) BIGTOP-2344
sed -i 's/Architectures: i386 amd64 source/Architectures: ppc64el source/' packages.gradle

docker run --rm -v `pwd`:/ws  bigtop/slaves:1.1.0-$BUILD_ENVIRONMENTS bash -c '
cd /ws ; . /etc/profile.d/bigtop.sh ;
A=rpm ; B=yum; 
type -p dpkg && A=deb ; 
type -p dpkg && B=apt ;
./gradlew allclean $A $B'

To build an RPM for a single project use ./gradlew <project name>-rpm. For example to build Spark RPM do:

# Build Spark RPM
cd ~/bigtop
./gradlew spark-rpm

To build all Bigtop RPMS use ./gradlew rpm:

# Build all RPMs
cd ~/bigtop
./gradlew rpm

To list all gradle tasks run cd ~/bigtop && ./gradlew tasks.

Jenkins job

docker run -u jenkins --rm -v `pwd`:/ws$DOCKER_SELINUX --workdir /ws -e COMPONENTS=$COMPONENTS  -e CONFIGURE_NEXUS=$CONFIGURE_NEXUS $NEXUS  bigtop/slaves:trunk-$OS \
bash -c '. /etc/profile.d/bigtop.sh; ./gradlew allclean $CONFIGURE_NEXUS $COMPONENTS-pkg && ./gradlew repo

----

3. Download the RPMs