Comparison of continuous integration software

This is a compendium of continuous integration software that supports a software engineering practice, continuous integration,[1] in which developers' changes are immediately tested and reported when they are added to the mainline code base. The comparison of various continuous integration tools is done on the basis of platform, license, builders and Integration IDEs.

## Features[edit]

This list is incomplete; you can help by adding missing items. (June 2018)

|

Name  | Platform | License | Builders: Windows | Builders: Java | Builders: other  | Notification  | Integration, IDEs | Integration, other

|
|
|
|
|
|
|
|

Apache Gump | Python | Apache 2.0  | Un­known  | Ant, Maven 1  | Un­known  | Email | Un­known  | Un­known
AppVeyor | Hosted, Self-Hosted  | Proprietary | Visual Studio, MSBuild, Psake  | No  | Custom Script, PowerShell | Email, HipChat, Slack | No  | GitHub, Bitbucket, Kiln, Windows Azure
Azure DevOps Server (formerly TFS and VSTS)  | Cross-platform  | Proprietary, MIT  | MSBuild, Visual Studio | Ant, Maven, Gradle, Android | C, C++, Go, Groovy, Java, Node.js, Perl, PHP, Python, Ruby | Email, SOAP | Visual Studio, Eclipse, IntelliJ IDEA, Android Studio, Visual Studio Code | GitHub, Jenkins, Slack, Hipchat, FindBugs, Checkstyle, PMD
Bamboo | Web container | Proprietary | MSBuild,[2] NAnt,[3] Visual Studio[4] | Ant,[5] Maven 1-2-3[6] | Custom script, command-line tool, Bash, Xcode,[7] Phing,[8] Grunt, Grails[9] | XMPP, Google Talk, Email, RSS, Remote API, HipChat | IntelliJ IDEA, Eclipse, Visual Studio | FishEye, Jira, Clover, Bitbucket, GitHub
Buddy | Cross-platform | Proprietary | No  | Ant, Maven, Gradle  | Elixir, Go, Haskell, Node.js, PHP, Python, Ruby, .NET Core  | Desktop, Email, Slack, SMS  | No  | Web Services, Bitbucket, GitHub, GitLab, Google Cloud Services, Heroku, Modulus
Buildbot | Python | GPL | Command-line  | Command-line  | Command-line  | Email, Web, GUI, IRC | Un­known  | Un­known
BuildMaster | Cross-platform | Proprietary | Yes  | Yes  | Cross-platform command-line  | Email, custom  | No  | Many
CircleCI | Hosted, Self-Hosted  | Proprietary | Command-line  | Command-line  | Command-line  | Email | Visual Studio Code | GitHub, Bitbucket, GitLab
GitLab | Hosted, Self-Hosted  | Proprietary, MIT  | Yes[10] | Maven,[11] Gradle[12] | SSH, Shell, VirtualBox, Parallels, Docker, Kubernetes, Custom[13] | Email, Web, Slack and others[14] | Gitpod,[15] WebIDE[16] | Many
GoCD | Cross-platform | Apache 2.0  | Command-line  | Command-line  | Command-line  | Email, hipchat, Slack, Gerrit, Gitter, Riemann etc | No  | GitHub
Jenkins | Web container | Creative Commons and MIT | MSBuild, NAnt, Batch Script | Ant, Maven 2, Kundo  | CMake, Gant, Gradle, Grails, Phing, Rake, Ruby, SCons, Python, shell script, command-line | Android, Email, Google Calendar, IRC, XMPP, RSS, Twitter, Slack, CCMenu, CCTray  | Eclipse, IntelliJ IDEA, NetBeans | Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac, HP ALM
OpenMake Software Meister  | Cross-platform | Proprietary | MSBuild, NAnt, Visual Studio | Ant, Maven 1-2-3  | Shell script, batch script, cross-platform command-line, Groovy, Make, RTC Jazz, TFS Build, Custom Script Interpreter  | Email, XMPP, RSS, Systray | Eclipse, Visual Studio | Bugzilla, Google Code, Jira, Bitbucket, Redmine, FindBugs, Checkstyle, PMD and Mantis, Trac
Semaphore (software) | Hosted  | Proprietary | No  | Maven, Gradle | Ruby, Java, Python, Node.js, PHP, Clojure, C/C++, Elixir, Erlang, Go, Rake, command-line | Email, Campfire, HipChat, Slack, Flowdock, Webhooks, Remote API  | Un­known  | GitHub, Bitbucket, Heroku, AWS, Code Climate,[17] Cloud 66
Travis CI | Hosted  | MIT | No  | Ant, Maven, Gradle[18] | C, C++, Clojure, Elixir, Erlang, Go, Groovy, Haskell, Java, Node.js, Perl, PHP, Python, Ruby, Rust, Scala, Smalltalk | Email, Campfire, HipChat, IRC, Slack, CCMenu, CCTray  | No  | GitHub, Heroku
TeamCity | Web container | Proprietary | MSBuild, NAnt, Visual Studio, ReSharper-based .NET code analysis  | Ant, Maven 2-3, Gradle, IntelliJ IDEA-based build and code analysis  | command-line, PowerShell,[19] Xcode,[20] Rake, FxCop | Email, XMPP, RSS, IDE, SysTray  | Eclipse, Visual Studio, IntelliJ IDEA, RubyMine, PyCharm, PhpStorm, WebStorm | JetBrains YouTrack, Jira, Bugzilla, FishEye, FindBugs, PMD, dotCover, NCover
Vexor | Hosted  | Proprietary | No  | Un­known  | Ruby, Clojure, Scala, Python, Node.js, Go, Rust, Haskell | Email, HipChat, Slack | Un­known  | GitHub, Bitbucket, GitLab
Buildkite | Self-hosted  | MIT | Command-line[21] | Unknown  | Ubuntu, Debian, Red Hat/CentOS, FreeBSD, macOS, Linux, Docker, AWS, Elastic CI Stack for AWS, Google Cloud  | Email, Basecamp, Slack, webhooks, pagerduty  | Unknown  | Okta, Google Workspace, GitHub, Azure AD, custom SAML, GraphQL, Amazon EventBridge, CC Menu, CCTray, Artifactory[22]
Tekton  | Kubernetes  | Apache 2.0  | Yes  | Yes  | Yes  | Yes  | Yes  | Many

## SCM system support[edit]

The following table compares the features of some of the most popular Continuous Integration software on the basis of the Source Control Management or the Version Control Management which is an essential part of CI Software system. The table shows some popular SCMs and whether they are supported by the CI software.

Name  | AccuRev | BitKeeper | CA Harvest | ClearCase | CVS | Darcs | Git | GNU Bazaar | Integrity | Mercurial | Perforce | Plastic | PVCS | StarTeam | Subversion | Surround | Synergy | Team Concert | TFVC | Vault | Visual SourceSafe

|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|

Apache Gump | No  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No
AppVeyor | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | Yes  | No  | No  | No  | No  | Yes[23] | No  | No  | No  | No  | No  | No
Azure DevOps Server | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | No  | Yes  | No  | No
Bamboo | Yes[24] | No  | No  | Yes  | Yes  | No  | Yes  | No  | No  | Yes  | Yes  | No  | No  | No  | Yes  | No  | No  | No  | Yes[25] | No  | No
Buddy | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No
BuildBot | No  | No  | No  | No  | Yes  | Yes  | Yes  | Yes  | No  | Yes  | Yes  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No
BuildMaster | Yes  | No  | No  | Yes  | Yes  | No  | Yes  | No  | Yes  | Yes  | Yes  | Yes  | Yes  | No  | Yes  | Yes  | No  | No  | Yes  | Yes  | Yes
Jenkins | Yes  | Yes  | Yes  | Yes  | Yes  | Yes[26] | Yes  | Yes  | Yes[27] | Yes  | Yes  | Yes[28] | Yes  | Yes  | Yes  | Yes[29] | Yes[30] | Yes[31] | Yes  | Yes[32] | Yes
OpenMake Software Meister  | Yes  | No  | Yes  | Yes  | Yes  | No  | Yes  | No  | Yes  | No  | Yes  | No  | Yes  | Yes  | Yes  | No  | Yes  | Yes  | Yes  | Yes  | Yes
Semaphore (software) | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No
TeamCity | Yes  | No  | No  | Yes  | Yes  | No  | Yes  | Yes[33] | No  | Yes  | Yes  | No  | No  | Yes  | Yes  | No  | No  | No  | Yes  | Yes  | Yes
Vexor | No  | No  | No  | No  | No  | No  | Yes  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No  | No

## References[edit]

1. ^ Integration, Continuous (2007). Continuous Integration: Improving Software Quality and Reducing Risk. Pearson Education. ISBN 9780321630148.
2. ^ "MSBuild | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
3. ^ "NAnt | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
4. ^ "Visual Studio | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
5. ^ "Ant | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
6. ^ "Maven | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
7. ^ "Xcode | Bamboo Server 8.0 | Atlassian Documentation". confluence.atlassian.com.
8. ^ "Phing | Bamboo Server 5.10 | Atlassian Documentation". confluence.atlassian.com.
9. ^ "Grails | Bamboo Server 5.11 | Atlassian Documentation". confluence.atlassian.com.
10. ^ "Install GitLab Runner on Windows | GitLab". docs.gitlab.com.
11. ^ "Maven packages in the Package Repository | GitLab". docs.gitlab.com.
12. ^ "Unit test reports | GitLab". docs.gitlab.com.
13. ^ "Executors | GitLab". docs.gitlab.com.
14. ^ "Project integrations | GitLab". docs.gitlab.com.
15. ^ "Gitpod Integration | GitLab". docs.gitlab.com.
16. ^ "Web IDE | GitLab". docs.gitlab.com.
17. ^ Code Climate "Getting Started with Code Climate Quality: Setting Up Test Coverage".
18. ^ "Travis CI Documentation". docs.travis-ci.com.
19. ^ "PowerShell | TeamCity On-Premises". TeamCity On-Premises Help.
20. ^ "Xcode Project | TeamCity On-Premises". TeamCity On-Premises Help.
21. ^ "Installing Buildkite agent". buildkite.com.
22. ^ "Integrations- Buildkite Docs". buildkite.com.
23. ^ "Build Environment".
24. ^ "Atlassian Marketplace". marketplace.atlassian.com.
25. ^ "Atlassian Marketplace". marketplace.atlassian.com.
26. ^ "Darcs Plugin - Jenkins - Jenkins Wiki".
27. ^ "PTC Windchill RV&S CM". PTC Windchill RV&S CM.
28. ^ "PlasticSCM Plugin - Jenkins - Jenkins Wiki".
29. ^ "Surround SCM Plugin - Jenkins - Jenkins Wiki".
30. ^ "Synergy Plugin - Jenkins - Jenkins Wiki".
31. ^ "Team Concert". Team Concert.
32. ^ "SourceGear Vault". SourceGear Vault.
33. ^ "Bazaar - TeamCity Plugin". JetBrains Marketplace.

## Further reading[edit]

* Paul M. Duvall, Steve Matyas, Andrew Glover (2007-06-29). Continuous Integration: Improving Software Quality and Reducing Risk. ISBN 9780321630148.`{{cite book}}`: CS1 maint: multiple names: authors list (link)
* Ching, Maria Odea; Porter, Brett (2009-09-15). Apache Maven 2 Effective Implementation: Build and Manage Applications with Maven, Continuum, and Archiva. Packt Publishing Ltd. ISBN 9781847194558.
* Melymuka, Volodymyr (2012-01-01). TeamCity 7 Continuous Integration Essentials. Packt Publishing Ltd. ISBN 9781849693776.