Scala Continuous Integration with GitLab

# Ma CI avec <br/> SBT et GitLab (-CI) Kévin Rauscher • [`@tomahna`](https://twitter.com/tomahna) --- ## Agenda 1. Qu'attend-on d'une CI  2. GitLab & GitLab CI  3. SBT et ses plugins  --- ## Qu'attend-on d'une CI -- #### Simple #### Notifications claires  ![](assets/gitlab_pipeline_failed.png)  #### Rapide & Scalable  ![](assets/gitlab_pipeline_success.png)  #### Polyvalente  --- ## Gitlab ![](assets/gitlab_logo.svg) -- > The leading integrated product for the entire software development lifecycle. -- ![](assets/gitlab.jpg) -- ## Gitlab-CI -- ### Tache ![](assets/tache.gif) -- ### Tache ```yaml hello: # <-- création de la tache "test" script: # <-- corps de la tache - echo "Hello PSUG" ``` -- ### Stage ![](assets/stage.jpg) -- ### Stage ```yaml stages: recette deploy-recette: stage: recette script: - export ENV=recette - ./deploy.sh ``` -- ### Pipeline Définis dans un fichier .gitlab-ci.yml ![](assets/gitlab_pipeline.png) -- ### Pipeline - Les stages s'exécutent séquentiellement  - Les taches s'exécutent en parallel  -- ## Et alors ça marche ? -- #### Simple Yaml + Shell = Peu de subtilités  #### Notifications claires  Bien intégré avec Gitlab  #### Rapide et Scalable  oui via installation de runners sur les machines de dev  #### Polyvalente  Bonne intégration avec docker  -- ### MAIS GitLab-CI => GitLab  -- ## Tests -- ### Tests unitaires ```yaml # .gitlab-ci.yml test: script: - sbt test ```  ![](assets/gitlab_pipeline_1.png)  -- ### Et la sbt télécharge les dépendances ![](assets/dead_waiting.jpg)  -- ### Coursier ```scala addSbtPlugin("io.get-coursier" % "sbt-coursier" % "1.0.0-RC13") ```  ![](assets/coursier.gif)  -- ### Code Format -- #### Exemple ```scala object FormatMe { List(number) match { case head :: Nil if head % 2 == 0 => "number is even" case head :: Nil => "number is not even" case Nil => "List is empty" } function(arg1, arg2(arg3(arg4, arg5, "arg6") , arg7 + arg8), arg9.select(1, 2, 3, 4, 5, 6)) } ```  -- ### ScalaRiform (Unopinionated) ```scala object FormatMe { List(number) match { case head :: Nil if head % 2 == 0 => "number is even" case head :: Nil => "number is not even" case Nil => "List is empty" } function(arg1, arg2(arg3(arg4, arg5, "arg6") , arg7 + arg8), arg9.select(1, 2, 3, 4, 5, 6)) } ```  -- ### ScalaFmt (Opinionated) ```scala object FormatMe { List(number) match { case head :: Nil if head % 2 == 0 => "number is even" case head :: Nil => "number is not even" case Nil => "List is empty" } function(arg1, arg2(arg3(arg4, arg5, "arg6"), arg7 + arg8), arg9.select(1, 2, 3, 4, 5, 6)) } ```  #### Besoin d'un formatage spécifique <=> besoin de refactoring  -- ### ScalaFmt & Gitlab ```scala // plugins.sbt addSbtPlugin("com.lucidchart" % "sbt-scalafmt-coursier" % "1.10") ```  ```yaml # .gitlab-ci.yml format: script: - sbt scalafmt::test ```  ![](assets/gitlab_pipeline_2.png)  -- ### Version des dépendances ```scala // plugins.sbt addSbtPlugin("com.timushev.sbt" % "sbt-updates" % "0.3.3") ```  ```yaml # .gitlab-ci.yml update: script: - sbt "set dependencyUpdatesFailBuild := true" dependencyUpdates allow_failure: true ```  --- ## Code Style et Qualité -- ### Scala Compiler ```scala scalacOptions ++= Seq( "-Yrangepos", "-Xlint", "-deprecation", "-feature", "-unchecked", "-Yno-adapted-args", "-Ywarn-dead-code", "-Ywarn-numeric-widen", "-Ywarn-value-discard", "-Xfuture", //"-Xfatal-warnings", si possible "-Ywarn-unused", "-Ywarn-unused-import", "-Ydelambdafy:method", ) ```  -- ### ScapeGoat 116 check implementés  ```scala addSbtPlugin("com.sksamuel.scapegoat" %% "sbt-scapegoat" % "1.0.4") ```  #### Unused Method Parameter  ```scala def func(a:Int, b:Int) = { val c = a+1; c } ```  #### Filter Dot Size  ```scala val a = Seq(1,2,3); val b = a.filter{ _ > 1 }.length ```  -- ### WartRemover ```scala //plugins.sbt addSbtPlugin("org.wartremover" % "sbt-wartremover" % "2.2.1") ```  ```scala //build.sbt wartremoverErrors ++= Warts.unsafe ```  ``` [error] /tmp/src/main/scala/test/Foo.scala:2: [wartremover:Null] null is disabled [error] val foo = null [error] ^ [error] one error found [error] (compile:compileIncremental) Compilation failed ```  -- ### Other plugins * ScalaStyle * ScalaLinter --- ## Versioning -- ### SBT Release ```scala releaseProcess := Seq[ReleaseStep]( checkSnapshotDependencies, inquireVersions, runClean, runTest, setReleaseVersion, commitReleaseVersion, tagRelease, publishArtifacts, setNextVersion, commitNextVersion, pushChanges ) ``` -- ### SBT Release ```scala releaseProcess := Seq[ReleaseStep]( checkSnapshotDependencies, inquireVersions, // <--- Etape manuelle runClean, runTest, setReleaseVersion, commitReleaseVersion, tagRelease, publishArtifacts, setNextVersion, commitNextVersion, pushChanges ) ``` -- ### SBT Release ```scala releaseProcess := Seq[ReleaseStep]( checkSnapshotDependencies, inquireVersions, runClean, runTest, setReleaseVersion, commitReleaseVersion, tagRelease, publishArtifacts, setNextVersion, commitNextVersion, pushChanges // <--- Et si ça échoue ? ) ``` -- ### Mais au fait c'est quoi une version ? -- ### Version Un point dans le temps * Arbitraire  * Unique  * Immutable (idéalement)  -- ### SBT Dynver ```scala addSbtPlugin("com.dwijnand" % "sbt-dynver" % "2.0.0") ``` ![](assets/dynver.png) --- ## Packaging et publication -- ### SBT Native Packager * Universal (zip, tgz, ...) * Debian * Rpm * Docker * Windows (pour les plus téméraires) -- ### Packaging avec Gitlab ```yaml stages: - test - package format: ... test: ... debian: stage: package only: master # N'execute la tache que sur master script: - sbt debian:packageBin artifacts: # Permet de télécharger les artefactes paths: - target/*.deb ``` -- ![](assets/gitlab_pipeline_3.png) -- ### Publication * Sonatype * Nexus * S3 (via sbt-s3-resolver/fm-sbt-s3-resolver) --- ## Conclusion #### SBT Complexe mais complet  #### Autobootstrap  #### Self contained repos  --- ## Merci ! Des questions ?