Commit Graph

150 Commits

Author SHA1 Message Date
jlal@mozilla.com
aa1d489d88 Bug 1131154 - Use fake buildprops file to bypass use of buildbotconfigs in mozharness r=garndt
--HG--
extra : rebase_source : 9bc360c7b40b1e3d9eb0c687eecf7990dd9afe77
2015-02-07 00:01:23 -08:00
jlal@mozilla.com
537cc4b3ac Bug 1131152 - Update tester image to use tc-vcs and download mozharness r=garndt
--HG--
extra : rebase_source : 36fe51e73ba81c49d3c0861de4a25c5857699df9
2015-02-06 23:08:48 -08:00
jlal@mozilla.com
070cfe8c1e Bug 1130106 - Schedule b2g-inbound jobs r=garndt
- Update scopes in decision task to something easier to use locally
  - Schedule flame builds (they may fail now)
  - Add optional revision-hash argument to decision task mach target
  - Use b2gtest worker type for tests
  - Use build specific worker types

--HG--
extra : rebase_source : dff37d59c35efcfc1698f2716e0fc0dc5e86937d
2015-02-06 00:18:42 -08:00
jlal@mozilla.com
1509d1a7ec Bug 1129143 - Upgrade tc-vcs and fix related emulator building issues r=wcosta
--HG--
extra : rebase_source : a22718c5d0b4fee099bdf5eea8e312e9f66b25ce
extra : source : 0c3168ac2a1bee766f5246828fda5a4aa769fbad
2015-02-05 12:15:44 -08:00
Dustin J. Mitchell
491b180125 Bug 1122589: prefer mockbuild-repos over puppetagain repos; r=jopsen
--HG--
extra : rebase_source : 37c1c39f172301fa19c656a423c20b51a2b3003b
extra : source : 253403427bb4af82a06b247707223a5d488e3b16
extra : histedit_source : 8adddc6c6f02d8efddfb156975690117ce5aa93f
2015-01-21 15:35:36 -05:00
Dustin J. Mitchell
36134991fe Bug 1122598: Refactor testing/docker to support Android; r=wcosta
* split much of base-build that's not useful for Android into b2g-build
 * always run docker with --no-cache, so we get the latest packages
 * improve README

--HG--
extra : rebase_source : 9446b68ae0ffd7cbdd2da831e208019a6974a636
extra : source : 91164440e535825949a2e7dda8909da2f6085dff
extra : histedit_source : 5b9e14c8714f1cbb1853e1ecdc3e3e9918830ce2
2015-01-21 10:45:34 -05:00
Wander Lairson Costa
6e82b7094f Bug 1085636 part2: Add gaia language files build option. r=lightsofapollo
--HG--
extra : rebase_source : 39c05b4a835c60fb8390e2320ee22c9c8caed5b6
extra : source : 1f82b9eb335d648becdebc5c743a488a820a0518
extra : histedit_source : c3cb57fe6d301b8e26b9eb702a15f24937e13511
2015-01-02 11:27:29 -02:00
Wander Lairson Costa
7d2724dac3 Bug 1085636 part1: Add "bc" utility to phone-builder image. r=lightsofapollo
This is necessary for Dolphin kernel build.

--HG--
extra : rebase_source : d15c5c6b3e4b8ed4adf45b5d9567bb82fd78e4dd
extra : source : 0f149d402baef03a0ad47dbfc466813a55aee6b9
extra : histedit_source : ed20505e19f559692e2f64df380f8eb438240c7b
2014-12-30 09:31:08 -02:00
Wander Lairson Costa
cae9908699 Bug 1085639: Add Nexus 4 user build. r=lightsofapollo
--HG--
extra : rebase_source : b3b79f3c5be338239924e597ab655bf85d906fab
extra : source : e5dba35f9e3eb5e2e3b5807476ded3309cc6e810
extra : histedit_source : f0d6da374b16c68a9f0f61d5499da75cca638474
2015-01-02 11:21:18 -02:00
Wander Lairson Costa
ee82a5777d Bug 1085632: Add Flame KK eng build task. r=lightsofapollo
--HG--
extra : rebase_source : a07ec2a7e181e03dfd20e5abe8930623205ac773
extra : source : dad8dbc115d4f791a655be9ca891e609c6e7e6a6
extra : histedit_source : 4bceea0d03cbe33572ea8393a5f7cdf3d2348fd2
2015-01-02 10:59:31 -02:00
Wander Lairson Costa
af65306906 Bug 1101166: Add custom mozharness repo and rev to taskcluster builds. r=lightsofapollo
taskcluster-build and taskcluster-trygraph now has two options to
specify mozharness custom repo and revision: --mozharness-repo and
--mozharness-rev.

--HG--
extra : rebase_source : 3c16d13596412ad2b66b1387e35c84e18d0addfc
extra : source : 0a3e1c17cf050ec53720cafd02e7bcf4ec166927
extra : histedit_source : fe0e4f9c0e5e35f984c9b2e65513b3fdd90583a6
2014-12-31 10:58:19 -02:00
Wander Lairson Costa
f898508e0d Bug 1109346: Use tc-vcs for cloning repos. r=lightsofapollo
--HG--
rename : testing/docker/phone-builder/tests/invalid_repo.yml => testing/docker/phone-builder/tests/invalid_head_repo.yml
extra : rebase_source : c94926e0159ebd3d4f86f0496d74262d68d32024
extra : source : b71cb513b0304ba272c04003c3d4deada9fee157
extra : histedit_source : 0ebef5f218febcbd2e813e4fdd1849e55c13604a
2014-12-23 18:15:32 -02:00
Wander Lairson Costa
d60be18043 Bug 1098467: Validate the task before build the phone image r=lightsofapollo.
Phone builds are special because they may contain vendor blobs that we
are not allowed to distribute. So, we have to make sure the task is not
leaking anything.

We check that the gecko repository is a mozilla oficial repository and
that we are not copying the built stuff to public folders.

--HG--
extra : rebase_source : 84f5b40ff0dcef5d0407832ef38f187ccef7766a
extra : source : 1520c6cd07da116dc1c7aac462d1807247cdc7f9
extra : histedit_source : d8d5db00102c06b3ab9937a1c86394cc6de9c4fd
2014-12-16 18:40:14 -02:00
Wander Lairson Costa
c334850732 Bug 1085631 part4: Add the phone build task. r=lightsofapollo
--HG--
extra : rebase_source : 84f4c39a1b5b9748d98979c66c4423ea30a1d377
extra : source : 5148fe501609cc6d0989ee599a0e6acfb4a0b981
extra : histedit_source : 5737189d8bf13358a142aac676171878c01d38c3
2014-12-16 12:24:56 -02:00
Wander Lairson Costa
c6f3c751d2 Bug 1085631 part3: Add phone builder docker image. r=lightsofapollo
As this image handles files containing partners blobs, it must be
private in quay.io, and the builds cannot be made public either.

You must use "-i" and "-k" build parameters to handle s3 credentials.

--HG--
extra : rebase_source : e23e07c93c04dd28052043be736ecaab3100c161
extra : source : 1bc2ad4d70eb91a4e98107685f7d6eacf603f7ac
extra : histedit_source : 473922c18f0fd18b1b1eebbc890f5e7960aacd43
2014-12-16 12:24:55 -02:00
Wander Lairson Costa
1d93fd43a0 Bug 1085631 part2: Allow the use of a custom build script. r=lightsofapollo
If the image folder contains an inner build.sh script, runs it to build
the image. The tag value is passed through a "-t" argument. All
arguments passed after the folder parameter are forwarded to the inner
build script.

--HG--
extra : rebase_source : 50a1f4d13e8d086f935425633f65a67e5d7e452f
extra : source : cc041ffa9a022399be1c18f9c01fb2b9b94b1efa
extra : histedit_source : 48c31997e540ea5acb2e93d9af4713a700e7e1e3
2014-12-16 12:24:55 -02:00
Wander Lairson Costa
af5de88aef Bug 1085631 part1: Replace b2g-config by target. r=lightsofapollo
In practice, there is no much difference between b2g-config and target
mozharness options, and we are fine specifying both with the same value.

We replace b2g-config by target in our mach command interface because
it seems easier to understand and will make the life for phone builds
easier.

--HG--
extra : rebase_source : 57a629563a17ddf6a1daa4e67e91a097b8081d09
extra : source : df726365e2761ff8c8b3849b03db72cf05f73500
extra : histedit_source : eaefaed9c6f3cf8273d9df425dd0f1e29c07c20d
2014-12-16 12:24:55 -02:00
jlal@mozilla.com
5d36eb255b Bug 1111980 - Part 5 fix bug where using moztt from cache breaks builds. r=garndt
--HG--
extra : rebase_source : a192ece73a35a498ca2328f63057bd66b998014e
extra : source : eff30c0f16e7309052546a31c40dc68156b8a2c4
2014-12-09 18:16:29 -08:00
James Lal
4c3088b130 Bug 1105439 - Part 9 Finalize decision task and simplify emulator caching logic r=wcosta, garndt
--HG--
extra : rebase_source : f59ae0290f04feaafefe893efa0d0da2eb635747
extra : source : deadeba968b58c4ee1fedb39854444938a27e8e9
2014-12-04 22:33:01 -08:00
James Lal
5a07ea71c6 Bug 1105439 - Part 4 Framework for inheriting one task from another. r=wcosta, garndt
Adds the $inherits key at the top level of all tasks within gecko. This initial
work covers the deep inheritance cases as well as cyclic references during
inheritance.

--HG--
extra : rebase_source : b48a70553af287356afa5e34a686e7ba2e6de21c
extra : source : 485adb4ce1ddc0280ed49fbd6e77e60431d74c2b
2014-11-29 15:05:46 -08:00
James Lal
39ea914b37 Bug 1105439 - Part 3 Initial decision task logic for gecko r=wcosta, garndt
--HG--
extra : rebase_source : 99f285bc44727c62c069781e81b3713b753da745
extra : source : cc2ac46d1bd5b321d222526e6ee0daf8e4283d70
2014-11-29 15:05:45 -08:00
James Lal
c280211568 Bug 1105439 - Part 2 Update builder to use tc-vcs for b2g-desktop/mulet (and related repos) r=wcosta, garndt
Primarily builder performance optimizations by leveraging both vcs caching and
docker caching improvmenets. By side effect this is also the ground work for
supporting git.

--HG--
extra : rebase_source : e680f43b426e8f02f340616975edf18c19a18bd4
extra : source : 7bb48bcb10e8f7a0b8c7b945d5add1bdc56dfed7
2014-11-29 15:05:44 -08:00
James Lal
c21d30198d Bug 1105439 - Part 1 New gaia_props.py util for getting gaia version needed by the gecko r=garndt, wcosta
Normalizes gaia tooling to a central file with a set of commands / help.

--HG--
extra : rebase_source : 50f0a7c0b993d46c9a5803e270ff30ea125fe8ad
extra : source : 4d711d8eb9177085e619923d3ae92419cc2dd257
2014-11-29 15:05:44 -08:00
Wander Lairson Costa
6a8f0f315c Bug 1102085: Use "mach environment" to extract the object directory r=lightsofapollo.
If "topobjdir" is None, use default object directory.

--HG--
extra : rebase_source : 0bfbd32686cce7479c652e9141ed83fa8a38967c
extra : source : 63101782f55005d8f74f576ec3447f264d6035b4
2014-11-26 10:11:41 -08:00
Wander Lairson Costa
5315cbee5d Bug 1098406: Fix gaia repository path r=garndt.
A commit in the mozilla-central repository [1] broke the gaia URL
repository URL construction code.

We now make sure our code works independent of the leading slash
presence.

[1] http://hg.mozilla.org/mozilla-central/rev/f3782f5c2710

--HG--
extra : rebase_source : b9266befc06d3566c22dc68581550ac8da798947
extra : source : 24b368aaa3cb6baff2f7de260d66d2719de63019
2014-11-26 10:11:41 -08:00
Greg Arndt
1990fbfe14 Bug 1104013 - Add reftest task for b2g emulator r=lightsofapollo
--HG--
extra : rebase_source : 94c4f24cbd08fd9921360daf0d2c93e3e670eeae
extra : source : 35970803778fce701f5b18dec95ad000aaa8b92f
2014-11-26 10:11:40 -08:00
Greg Arndt
d26bd529b7 bug 1103031 - create artifacts directory in tester r=lightsofapollo
--HG--
extra : rebase_source : 36ba94c25ceef012f501819422554e5344288931
extra : source : 1238e0af84c1e9001145814818bffa1426b2a888
2014-11-26 10:11:40 -08:00
Greg Arndt
4d329fbbaa Bug 1103031 - switch over to using base-test and base-build images r=lightsofapollo
--HG--
rename : testing/docker/base/Dockerfile => testing/docker/base-build/Dockerfile
rename : testing/docker/base/system-setup.sh => testing/docker/base-build/system-setup.sh
rename : testing/docker/base/Dockerfile => testing/docker/base-test/Dockerfile
extra : rebase_source : b0f10136c2dfbffca3b4f77e16820b046f6edbe9
extra : source : 5fcc4a5663467e57bd5a36eef3a6669062886f97
2014-11-26 10:11:40 -08:00
Greg Arndt
0ad29e8349 Bug 1099239 - add reftests to linux64 mulet r=lightsofapollo
--HG--
extra : rebase_source : e3e7881e766a78ab00173e17436237294755a72a
extra : source : 35a7d68956cdb3cbf26fc7296b05315e54e77542
2014-11-26 10:11:38 -08:00
Greg Arndt
678c5031b6 Bug 1099217 - add support for gaia js integration tests r=lightsofapollo
--HG--
extra : rebase_source : 505de6b0ff25a58ab46de807d434b918025e5ad7
extra : source : d13338844aff2919dc85aca6b5f7be846e175484
2014-11-26 10:11:38 -08:00
Greg Arndt
44625d068e Bug 1095480 - enable mochitests for linux64 mulet r=lightsofapollo,mshal
--HG--
extra : rebase_source : b804d42570094df4232011fb5ecc4cb7568e5562
extra : source : 320c6c008bddfb3993c7724ee6d1babcee5591de
2014-11-26 10:11:37 -08:00
Greg Arndt
0bfe652960 BUG 1093830 - builds need moztt package r=lightsofapollo
--HG--
extra : rebase_source : c7925ffc70d87f5afb829cd9d164cca7c8141cfe
extra : source : 074bff523826013a9d120e282abdd39d3bfb6d0c
2014-11-26 10:11:37 -08:00
Wander Lairson Costa
824d0ebe0c Bug 1098336: Use mozharness debug flag for emulator debug builds.
--HG--
extra : rebase_source : c01b02793cddab9ac334d25d6ca287bee3ee2c3a
extra : source : 58bdb89189e49a3fca3f2a790b9283d2576a9466
2014-11-26 10:11:36 -08:00
Wander Lairson Costa
80e01e756c Bug 1085620 part3: Add emulator build task. r=lightsofapollo
The "mach ci-build" has a new optional argument called b2g-config. This
allows the user to pass the b2g config directory for the target. This
argument is necessary for emulator and phone builds.

--HG--
extra : rebase_source : 40724b5d1b9b33961180e2a019a7237ca13410b4
extra : source : c20ec1fd15670422f517c352c388bd036c454fb6
2014-11-26 10:11:34 -08:00
Wander Lairson Costa
146f5a3c4d Bug 1085620 part2: Support for emulator builds in the builder image. r=lightsofapollo
The setup of builder image moved to system-setup.sh script because
needs to do more complex work, like downloading repo and installing
mozilla buildtools package.

The build-emulator.sh script is reponsible for building emulators.
Besides the REPOSITORY and REVISION environment variables, it requires
TARGET and B2G_CONFIG too.

--HG--
extra : rebase_source : 670c03f343a6d6aca51f81373aa5c6734d4b8b6b
extra : source : 30b4e858f2c3d5f093ad87c6098d0d1298ca2fdb
2014-11-26 10:11:34 -08:00
Wander Lairson Costa
733c1605bb Bug 1085620 part1: Install virtualenv in the base image. r=lightsofapollo
virtualenv is a dependency for mozharness.

--HG--
extra : rebase_source : a99c7ecc014d3039859d053572681929d007c9c8
extra : source : 336b87456be85c55b4573b2ae8cfb6b3c61dfabe
2014-11-26 10:11:34 -08:00
Greg Arndt
3e0b6c6422 Bug 1085516 - gecko builds: Add Mulet Linux x64 Opt r=lightsofapollo, wcosta
--HG--
rename : testing/docker/builder/build-b2g-desktop.sh => testing/docker/builder/bin/build-b2g-desktop.sh
rename : testing/docker/builder/build-b2g-desktop.sh => testing/docker/builder/bin/build-mulet-linux.sh
rename : testing/docker/builder/build-setup.sh => testing/docker/builder/bin/build-setup.sh
rename : testing/docker/builder/build.sh => testing/docker/builder/bin/build.sh
rename : testing/docker/builder/get-objdir.py => testing/docker/builder/bin/get-objdir.py
rename : testing/docker/builder/get_gaia_repo.js => testing/docker/builder/bin/get_gaia_repo.js
rename : testing/docker/builder/get_gaia_revision.js => testing/docker/builder/bin/get_gaia_revision.js
rename : testing/taskcluster/tasks/builds/b2g_desktop.yml => testing/taskcluster/tasks/builds/mulet_linux.yml
extra : rebase_source : 27c0bcb0e99214f5994c1e9a98ab91f3ed9a747c
extra : source : cb990f8f1c8140a287fecae536b59f39c3d745e6
2014-11-26 10:11:33 -08:00
Wander Lairson Costa
ab0672d554 Bug 1085505 part1: Update tester image to create "artifacts" directory r=lightsofapollo,garndt.
Artifacts are stored in the /home/worker/artifacts directory. If this
directory doesn't exist, the task finishes unsuccessfully.

--HG--
extra : rebase_source : 96829c518bd31baa1921b996af6231a5a758550f
extra : source : c467a0bb28714e52ce1fe97a04a90679650b0800
2014-11-26 10:11:32 -08:00
Greg Arndt
7c48f0489a Bug 1091850 - Use worker for build tasks r=wcosta
--HG--
extra : rebase_source : 8b721e357428d880ae31d56c8318d0cc1e5e9419
extra : source : 6b05c1f86596e46e1fe6cc249aac59216bec9860
2014-11-26 10:11:32 -08:00
Greg Arndt
35668e61f2 Bug 1091850 - Use worker for build tasks r=wcosta
--HG--
extra : rebase_source : 93802e5aeff99351a601d7ace7be5559d1460d90
extra : source : ca02980769b64f144a303fd835b445d773002a91
2014-11-26 10:11:31 -08:00
Greg Arndt
94f593e768 Bug 1091850 - Use worker for build tasks r=wcosta
--HG--
extra : rebase_source : d7447854c147a15587f161d20e64f1e98b9086e3
extra : source : d4e33dca82fa133dd133b793155fb94915b15e94
2014-11-26 10:11:31 -08:00
Rob Wood
fdfd61d532 Bug 1090404 : Update docker tester image to use gecko-tree base image r=lightsofapollo
--HG--
extra : rebase_source : a5393f1882c14b5ae122e9b496c637833887702c
extra : source : 7cf8f96e169b953fc538419dfe214e5949a4cf56
2014-11-26 10:11:31 -08:00
Wander Lairson Costa
32f7797606 Bug 1085513 part3: Remove unused mozconfig files r=lightsofapollo,garndt.
Since we now use the gecko tree mozconfigs for building, the docker
mozconfigs are no longer necessary.

--HG--
extra : rebase_source : 86518f6418a00963e9abd23df288fce75d8f52e5
extra : source : bb3a81a684a1d66ae70242609c436b12405970bb
2014-11-26 10:11:30 -08:00
Wander Lairson Costa
e4a5da8c2b Bug 1085513 part1: Detect the mozconfig obj directory. r=lightsofapollo, garndt
We cannot hardcode the object directory because it is configurable
inside the mozconfig file.

Parse the mozconfig and extract the object directory. If it is not
defined, defaults to "/home/worker/object-folder".

--HG--
extra : rebase_source : 25eb9e7306d8844b20459c01b1a9a7ee85f3f03d
extra : source : 76e4a3bad9bc5eb124014b0332f82db17bdace11
2014-11-26 10:11:30 -08:00
Wander Lairson Costa
2cae2bb3e0 Bug 1087456 part4: use build-setup vars to reference repos. r=lightsofapollo,garndt
--HG--
extra : rebase_source : 0d2afcb93e1f5f3e992b3d888abd78fa9ca6370d
extra : source : a3d9683617a8ed72203345f4f268241d5d11c658
2014-11-26 10:11:29 -08:00
Wander Lairson Costa
7a498d7626 Bug 1087456 part3: create repositories parent dirs if they don't exist. r=lightsofapollo,garndt
Older versions of mercurial cannot create inner directories if the
parents don't exist.

--HG--
extra : rebase_source : 0a996db89416da64ca7be228814f208975a42570
extra : source : 42a93ffc374f4ef08a8b2f31d1f7ce1067fead15
2014-11-26 10:11:29 -08:00
Wander Lairson Costa
f849ffd29f Bug 1087456 part2: change builder image from "gecko-base" to "base". r=lightsofapollo,garndt
builder image is now based on the "base" image that lives on gecko
tree.

--HG--
extra : rebase_source : a22e083dca220a52e1b84cf5479969a6c1dc6882
extra : source : 664164ad527d89ce83812d15f99aaff656430f4b
2014-11-26 10:11:29 -08:00
Wander Lairson Costa
4a5b08d277 Bug 1087456 part1: Update base image to CentOS 7. r=lightsofapollo,garndt
releng uses CentOS for CI. In order to reuse their packages, we also
move from Ubuntu to CentOS for our base images.

--HG--
extra : rebase_source : 4c98b24c094391124c5c0239c9191ad83938d914
extra : source : 7392eb8c25c4bec041ac480064c8bdd1c0bdecb8
2014-11-26 10:11:29 -08:00
James Lal
5a27e03e0c Bug 1068653 - Part 2 add taskcluster trygraph commands r=wcosta, garndt, mdas
--HG--
extra : rebase_source : 4d2c484bc780bd20c13b9bca129bd173ac66624a
extra : source : 630a93355767c7813dc7b761309f6728a79c2c80
2014-11-26 10:11:28 -08:00
Morgan Phillips
9894e3c6f8 Bug 1125973: Docker images for building Firefox Desktop and for Android; r=garndt
This creates two images:

 * ubuntu-build is a basic Ubuntu Trusty image with the build prerequisites
   installed via MozBootstrap (plus some additional requirements).  It also
   contains the worker user and basic directory structure expected by
   Mozharness.

 * desktop-build is a refinement of ubuntu-build with specifics for building
   Firefox Desktop (and, as it turns out, Firefox for Android).  It sports a
   `bin/build.sh` which acts as a fairly generic mozharness-runner that first
   checks out the desired source code revisions, then invokes Mozharness.  It
   supports:

    * caches -- tooltool, workspace, tc-vcs
    * starting and stopping Xvfb if necessary (desktop tests require this)
    * specifying mozharness build variant, branch, and build pool
    * supplying a RelengAPI token
    * copying uploads to the artifacts directory
2015-05-12 16:22:09 -04:00