b9d9418334
optimize size and time using "--no-cache-dir"
...
Using "--no-cache-dir" flag in pip install ,make sure dowloaded packages
by pip don't cached on system . This is a best practise which make sure
to fetch ftom repo instead of using local cached one . Further , in case
of Docker Containers , by restricing caching , we can reduce image size.
In term of stats , it depends upon the number of python packages
multiplied by their respective size . e.g for heavy packages with a lot
of dependencies it reduce a lot by don't caching pip packages.
Further , more detail information can be found at
https://medium.com/sciforce/strategies-of-docker-images-optimization-2ca9cc5719b6
2020-07-25 13:26:52 +05:30
c81ac8ec3b
Merge pull request #2672 from amscanne:shim-integrated
...
PiperOrigin-RevId: 321053634
2020-07-13 16:10:58 -07:00
b8f165ab1c
Fix HTTPD benchmarks to correctly serve files from /tmp.
...
Fixes #3113
PiperOrigin-RevId: 319216671
2020-07-01 06:58:56 -07:00
b070e218c6
Add support for Stack level options.
...
Linux controls socket send/receive buffers using a few sysctl variables
- net.core.rmem_default
- net.core.rmem_max
- net.core.wmem_max
- net.core.wmem_default
- net.ipv4.tcp_rmem
- net.ipv4.tcp_wmem
The first 4 control the default socket buffer sizes for all sockets
raw/packet/tcp/udp and also the maximum permitted socket buffer that can be
specified in setsockopt(SOL_SOCKET, SO_(RCV|SND)BUF,...).
The last two control the TCP auto-tuning limits and override the default
specified in rmem_default/wmem_default as well as the max limits.
Netstack today only implements tcp_rmem/tcp_wmem and incorrectly uses it
to limit the maximum size in setsockopt() as well as uses it for raw/udp
sockets.
This changelist introduces the other 4 and updates the udp/raw sockets to use
the newly introduced variables. The values for min/max match the current
tcp_rmem/wmem values and the default value buffers for UDP/RAW sockets is
updated to match the linux value of 212KiB up from the really low current value
of 32 KiB.
Updates #3043
Fixes #3043
PiperOrigin-RevId: 318089805
2020-06-24 10:24:20 -07:00
07ff909e76
Support setsockopt SO_SNDBUF/SO_RCVBUF for raw/udp sockets.
...
Updates #173,#6
Fixes #2888
PiperOrigin-RevId: 317087652
2020-06-18 06:07:20 -07:00
7f92190795
Bump puma from 3.12.4 to 3.12.6 in /benchmarks/workloads/ruby_template
...
Bumps [puma](https://github.com/puma/puma ) from 3.12.4 to 3.12.6.
- [Release notes](https://github.com/puma/puma/releases )
- [Changelog](https://github.com/puma/puma/blob/master/History.md )
- [Commits](https://github.com/puma/puma/commits )
Signed-off-by: dependabot[bot] <support@github.com >
2020-06-05 21:25:29 +00:00
d208bb86ac
Merge pull request #2789 from Rajpratik71:optimization/git-clone
...
PiperOrigin-RevId: 314855924
2020-06-05 11:29:53 -07:00
839208f118
Enable TCP Receive buffer moderation in gonet and benchmark.
...
Fixes #1666
PiperOrigin-RevId: 314148384
2020-06-01 10:29:47 -07:00
1495d4448f
optimization in git clone using --depth
...
optimize the git clone using --depth flag in term of size of clone
and also in term's of time taken to fetch the files and commit history
of whole repository .
More detail can be found at blog
https://www.atlassian.com/git/tutorials/big-repositories
Signed-off-by: Pratik Raj <rajpratik71@gmail.com >
2020-05-28 09:36:14 +05:30
ae15d90436
FIFO QDisc implementation
...
Updates #231
PiperOrigin-RevId: 309323808
2020-04-30 16:41:00 -07:00
64723470a6
Use existing bazeldefs with top-level BUILD file.
...
PiperOrigin-RevId: 308901116
2020-04-28 14:46:19 -07:00
a471105367
benchmarks: use absolute bazel target
...
bazel run :benchmarks only works from the benchmarks directory.
bazel run //benchmarks works from anywhere in the workspace.
Also fix help commands, which should be a multiline code section.
2020-04-21 15:52:42 -04:00
1a597e01be
Add a functional vm_test for root_test.
...
This change renames the tools/images directory to tools/vm for clarity, and
adds a functional vm_test. Sharding is also added to the same test, and some
documentation added around key flags & variables to describe how they work.
Subsequent changes will add vm_tests for other cases, such as the runtime tests.
PiperOrigin-RevId: 307492245
2020-04-20 15:48:27 -07:00
aa75a3da51
Fix build.sh and VM targets.
...
PiperOrigin-RevId: 306289643
2020-04-13 12:48:38 -07:00
4aee370640
Internal change.
...
PiperOrigin-RevId: 303773475
2020-03-30 10:44:55 -07:00
b9210b2855
Fix bm-tools to run on bazel.
...
Fixes random stuff that is broken on bazel/kokoro.
- random output coming back as "bytes" object instead of str
- missed syntax error in bazel
- a flag is missing in the version of gcloud on kokoro
PiperOrigin-RevId: 301915289
2020-03-19 16:07:05 -07:00
bc319d29e1
Bump puma from 3.12.2 to 3.12.4 in /benchmarks/workloads/ruby
...
Bumps [puma](https://github.com/puma/puma ) from 3.12.2 to 3.12.4.
- [Release notes](https://github.com/puma/puma/releases )
- [Changelog](https://github.com/puma/puma/blob/master/History.md )
- [Commits](https://github.com/puma/puma/compare/v3.12.2...v3.12.4 )
Signed-off-by: dependabot[bot] <support@github.com >
2020-03-07 02:31:42 +00:00
bfbfaf325b
Merge pull request #2056 from google:dependabot/bundler/benchmarks/workloads/ruby_template/puma-3.12.4
...
PiperOrigin-RevId: 299480247
2020-03-06 18:30:33 -08:00
9b26d2fa0d
Bump puma from 3.12.2 to 3.12.4 in /benchmarks/workloads/ruby_template
...
Bumps [puma](https://github.com/puma/puma ) from 3.12.2 to 3.12.4.
- [Release notes](https://github.com/puma/puma/releases )
- [Changelog](https://github.com/puma/puma/blob/master/History.md )
- [Commits](https://github.com/puma/puma/compare/v3.12.2...v3.12.4 )
Signed-off-by: dependabot[bot] <support@github.com >
2020-03-04 01:22:58 +00:00
9a4495fb87
Bump rake from 12.3.2 to 12.3.3 in /benchmarks/workloads/ruby
...
Bumps [rake](https://github.com/ruby/rake ) from 12.3.2 to 12.3.3.
- [Release notes](https://github.com/ruby/rake/releases )
- [Changelog](https://github.com/ruby/rake/blob/master/History.rdoc )
- [Commits](https://github.com/ruby/rake/compare/v12.3.2...v12.3.3 )
Signed-off-by: dependabot[bot] <support@github.com >
2020-03-04 01:22:58 +00:00
ff681b1747
Bump puma from 3.12.1 to 3.12.2 in /benchmarks/workloads/ruby
...
Bumps [puma](https://github.com/puma/puma ) from 3.12.1 to 3.12.2.
- [Release notes](https://github.com/puma/puma/releases )
- [Changelog](https://github.com/puma/puma/blob/master/History.md )
- [Commits](https://github.com/puma/puma/compare/v3.12.1...v3.12.2 )
Signed-off-by: dependabot[bot] <support@github.com >
2020-02-27 20:52:41 +00:00
0eafb7eb27
Bump puma from 3.12.0 to 3.12.2 in /benchmarks/workloads/ruby_template
...
Bumps [puma](https://github.com/puma/puma ) from 3.12.0 to 3.12.2.
<details>
<summary>Release notes</summary>
*Sourced from [puma's releases](https://github.com/puma/puma/releases ).*
> v3.12.1
</details>
<details>
<summary>Changelog</summary>
*Sourced from [puma's changelog](https://github.com/puma/puma/blob/master/History.md ).*
> ## 4.3.1 and 3.12.2 / 2019-12-05
>
> * Security
> * Fix: a poorly-behaved client could use keepalive requests to monopolize Puma's reactor and create a denial of service attack. CVE-2019-16770.
>
> ## 4.3.0 / 2019-11-07
>
> * Features
> * Strip whitespace at end of HTTP headers ([#2010 ](https://github-redirect.dependabot.com/puma/puma/issues/2010 ))
> * Optimize HTTP parser for JRuby ([#2012 ](https://github-redirect.dependabot.com/puma/puma/issues/2012 ))
> * Add SSL support for the control app and cli ([#2046 ](https://github-redirect.dependabot.com/puma/puma/issues/2046 ), [#2052 ](https://github-redirect.dependabot.com/puma/puma/issues/2052 ))
>
> * Bugfixes
> * Fix Errno::EINVAL when SSL is enabled and browser rejects cert ([#1564 ](https://github-redirect.dependabot.com/puma/puma/issues/1564 ))
> * Fix pumactl defaulting puma to development if an environment was not specified ([#2035 ](https://github-redirect.dependabot.com/puma/puma/issues/2035 ))
> * Fix closing file stream when reading pid from pidfile ([#2048 ](https://github-redirect.dependabot.com/puma/puma/issues/2048 ))
> * Fix a typo in configuration option `--extra_runtime_dependencies` ([#2050 ](https://github-redirect.dependabot.com/puma/puma/issues/2050 ))
>
> ## 4.2.1 / 2019-10-07
>
> * 3 bugfixes
> * Fix socket activation of systemd (pre-existing) unix binder files ([#1842 ](https://github-redirect.dependabot.com/puma/puma/issues/1842 ), [#1988 ](https://github-redirect.dependabot.com/puma/puma/issues/1988 ))
> * Deal with multiple calls to bind correctly ([#1986 ](https://github-redirect.dependabot.com/puma/puma/issues/1986 ), [#1994 ](https://github-redirect.dependabot.com/puma/puma/issues/1994 ), [#2006 ](https://github-redirect.dependabot.com/puma/puma/issues/2006 ))
> * Accepts symbols for `verify_mode` ([#1222 ](https://github-redirect.dependabot.com/puma/puma/issues/1222 ))
>
> ## 4.2.0 / 2019-09-23
>
> * 6 features
> * Pumactl has a new -e environment option and reads `config/puma/<environment>.rb` config files ([#1885 ](https://github-redirect.dependabot.com/puma/puma/issues/1885 ))
> * Semicolons are now allowed in URL paths (MRI only), useful for Angular or Redmine ([#1934 ](https://github-redirect.dependabot.com/puma/puma/issues/1934 ))
> * Allow extra dependencies to be defined when using prune_bundler ([#1105 ](https://github-redirect.dependabot.com/puma/puma/issues/1105 ))
> * Puma now reports the correct port when binding to port 0, also reports other listeners when binding to localhost ([#1786 ](https://github-redirect.dependabot.com/puma/puma/issues/1786 ))
> * Sending SIGINFO to any Puma worker now prints currently active threads and their backtraces ([#1320 ](https://github-redirect.dependabot.com/puma/puma/issues/1320 ))
> * Puma threads all now have their name set on Ruby 2.3+ ([#1968 ](https://github-redirect.dependabot.com/puma/puma/issues/1968 ))
> * 4 bugfixes
> * Fix some misbehavior with phased restart and externally SIGTERMed workers ([#1908 ](https://github-redirect.dependabot.com/puma/puma/issues/1908 ), [#1952 ](https://github-redirect.dependabot.com/puma/puma/issues/1952 ))
> * Fix socket closing on error ([#1941 ](https://github-redirect.dependabot.com/puma/puma/issues/1941 ))
> * Removed unnecessary SIGINT trap for JRuby that caused some race conditions ([#1961 ](https://github-redirect.dependabot.com/puma/puma/issues/1961 ))
> * Fix socket files being left around after process stopped ([#1970 ](https://github-redirect.dependabot.com/puma/puma/issues/1970 ))
> * Absolutely thousands of lines of test improvements and fixes thanks to [@​MSP-Greg](https://github.com/MSP-Greg )
>
> ## 4.1.1 / 2019-09-05
>
> * 3 bugfixes
> * Revert our attempt to not dup STDOUT/STDERR ([#1946 ](https://github-redirect.dependabot.com/puma/puma/issues/1946 ))
> * Fix socket close on error ([#1941 ](https://github-redirect.dependabot.com/puma/puma/issues/1941 ))
> * Fix workers not shutting down correctly ([#1908 ](https://github-redirect.dependabot.com/puma/puma/issues/1908 ))
>
> ## 4.1.0 / 2019-08-08
>
></tr></table> ... (truncated)
</details>
<details>
<summary>Commits</summary>
- [`bb29fc7`](https://github.com/puma/puma/commit/bb29fc7fe8f822d0f72706a1ae86e49af3476777 ) 3.12.2
- [`058df12`](https://github.com/puma/puma/commit/058df12b78e7d1ec661c3b8777f26a736c26675b ) 4.3.1 and 4.2.1 release notes
- [`06053e6`](https://github.com/puma/puma/commit/06053e60908074bb38293d4449ea261cb009b53e ) Merge pull request from GHSA-7xx3-m584-x994
- [`461c9e9`](https://github.com/puma/puma/commit/461c9e99783e5f69e632acedae83be55017d5fe4 ) Docs files
- [`7e2c88d`](https://github.com/puma/puma/commit/7e2c88d4131a1a70f551287e49b8f527d29d0469 ) v3.12.1
- [`36964ec`](https://github.com/puma/puma/commit/36964ec42982d7b3205760bc2bf9ccf3fec8af69 ) Merge pull request [#1700 ](https://github-redirect.dependabot.com/puma/puma/issues/1700 ) from schneems/schneems/fix-puma-rack-handler-config
- [`c24c0c8`](https://github.com/puma/puma/commit/c24c0c883496f581d9092bbe7f7431129eeb7190 ) Rack handler should use provided default host
- [`e5d566e`](https://github.com/puma/puma/commit/e5d566ed81f3663d70f0318f8bf3d858734cb74b ) Merge pull request [#1682 ](https://github-redirect.dependabot.com/puma/puma/issues/1682 ) from MSP-Greg/update-travis-ruby
- [`cecc44a`](https://github.com/puma/puma/commit/cecc44aa0ae326e46031b48023253d08df706455 ) Merge pull request [#1701 ](https://github-redirect.dependabot.com/puma/puma/issues/1701 ) from schneems/schneems/m
- [`ce57cfb`](https://github.com/puma/puma/commit/ce57cfb8c3c8259cda13c322de32dd4ff07ec03a ) Allow running individual tests via the `m` gem.
- Additional commits viewable in [compare view](https://github.com/puma/puma/compare/v3.12.0...v3.12.2 )
</details>
<br />
[](https://help.github.com/articles/configuring-automated-security-fixes )
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot ignore this [patch|minor|major] version` will close this PR and stop Dependabot creating any more for this minor/major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
- `@dependabot use these labels` will set the current labels as the default for future PRs for this repo and language
- `@dependabot use these reviewers` will set the current reviewers as the default for future PRs for this repo and language
- `@dependabot use these assignees` will set the current assignees as the default for future PRs for this repo and language
- `@dependabot use this milestone` will set the current milestone as the default for future PRs for this repo and language
You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/google/gvisor/network/alerts ).
</details>
COPYBARA_INTEGRATE_REVIEW=https://github.com/google/gvisor/pull/1345 from google:dependabot/bundler/benchmarks/workloads/ruby_template/puma-3.12.2 2be8d923b4cf5452e763ce369803f2729876b209
PiperOrigin-RevId: 297664218
2020-02-27 12:51:25 -08:00
246b34dabd
Bump rack from 2.0.7 to 2.2.2 in /benchmarks/workloads/ruby
...
Bumps [rack](https://github.com/rack/rack ) from 2.0.7 to 2.2.2.
- [Release notes](https://github.com/rack/rack/releases )
- [Changelog](https://github.com/rack/rack/blob/master/CHANGELOG.md )
- [Commits](https://github.com/rack/rack/compare/2.0.7...v2.2.2 )
Signed-off-by: dependabot[bot] <support@github.com >
2020-02-27 20:26:02 +00:00
3733499952
Fix master installer.
...
Sometimes, when we start a new instance, the file
lock on "apt" is locked. Add a loop to the master
installer.
In addition, the "apt-get install" fails to register
runsc in docker, so run the appropriate scripts to
get that to happen.
Also, add some helpful log messages.
PiperOrigin-RevId: 296497357
2020-02-21 13:18:51 -08:00
fe92fb36ac
Add flag to run without building baked images.
...
Adds flag to :benchmarks to allow running without
building "baked images", which depends on gcloud.
Users can skip gcloud workflows using the following:
blaze run --define gcloud=off :benchmarks -- my-command-without-gcloud
"run-gcp" will not work with the flag set, but all other commands will.
PiperOrigin-RevId: 295627718
2020-02-17 15:02:20 -08:00
Pratik raj
gVisor bot
Bhasker Hariharan
dependabot[bot]
Nicolas Lacasse
Adin Scannell
Michael Pratt
Zach Koopmans