Grpc next (#119)

* Stash changes on this WIP branch to advance state of GRPC stuff.

* WIP with more recent inputs, same basic fail...

* Checkpoint at state where we are trying to cd into th external/com_github_grpc_grpc for reflection.proto

* First working version!

* Move WORKSPACE experimental rules to deps.bzl

* Rename to com_google_protobuf

* Migrate to com_google_grpc and update java deps

* Update all to latest

* Buildify all the things

* Fix python, csharp and introduce generated DEPENDENCIES.md

* Convert http to https, use relative local_reposistory

* Rebase on master and finalize changes for 0.8.0

Author: pcj

.travis.yml

@@ -8,11 +8,8 @@ os:
   - osx
 
 env:
-  - V=0.4.5
-  - V=0.4.4
-  - V=0.4.3
-  - V=0.4.1
-  - V=0.3.1
+  - V=0.5.4
+  - V=0.5.2
 
 before_install:
   - OS=linux
@@ -30,49 +27,10 @@ before_install:
   - chmod +x install.sh
   - ./install.sh --user
   - rm -f install.sh
+  - sudo pip install grpcio==1.6.0
 
 script:
-  - |
-    bazel \
-      --output_base=$HOME/.cache/bazel \
-      --batch \
-      --host_jvm_args=-Xmx500m \
-      --host_jvm_args=-Xms500m \
-      test \
-      --verbose_failures \
-      --test_output=errors \
-      --test_strategy=standalone \
-      --spawn_strategy=standalone \
-      --genrule_strategy=standalone \
-      --local_resources=400,2,1.0 \
-      --worker_verbose \
-      --strategy=Javac=worker \
-      --strategy=Closure=worker \
-      --deleted_packages=tests/external_proto_library \
-      //examples/helloworld/closure/... \
-      //examples/helloworld/cpp/... \
-      //examples/helloworld/go/... \
-      //examples/helloworld/grpc_gateway/... \
-      //examples/helloworld/java/... \
-      //examples/wkt/... \
-      $FLAGS \
-    && \
-    (cd tests/external_proto_library && bazel \
-      --output_base=$HOME/.cache/bazel \
-      --batch \
-      --host_jvm_args=-Xmx500m \
-      --host_jvm_args=-Xms500m \
-      build \
-      --verbose_failures \
-      --test_output=errors \
-      --test_strategy=standalone \
-      --spawn_strategy=standalone \
-      --genrule_strategy=standalone \
-      --local_resources=400,2,1.0 \
-      --worker_verbose \
-      --strategy=Javac=worker \
-      --strategy=Closure=worker \
-      //:*)
+  - make all
 
 notifications:
   email: false

BUILD

@@ -1,3 +1,11 @@
 load("@io_bazel_rules_go//go:def.bzl", "go_prefix")
 
 go_prefix("github.com/pubref/rules_protobuf")
+
+
+load("//protobuf:rules.bzl", "proto_dependencies")
+
+proto_dependencies(
+    name = "deps",
+    format = "markdown",
+)

CHANGES.md

@@ -0,0 +1,47 @@
+## v0.8.0 (Wed Sep 6 2017)
+
+This is a significant (possibly overreaching) update that brings grpc
+support up to latest.  rules_protobuf should also load much faster
+than previously.  Some of the names of external workspaces have
+changed that may break your build (for example, string references such
+as 'external/com_github_google_protobuf/src' should be migrated to
+'external/com_google_protobuf/src' in an 'imports' attribute).
+
+* Introduce cpp/grpc_repository.bzl to setup a custom @com_google_grpc
+  external workspace (no longer using git_repository#init_submodules).
+  This pulls down grpc/grpc from github as @com_google_grpc_base, sets
+  up a mirrored external workspace in @com_google_grpc that symlinks
+  to @com_google_grpc_base, then does a "git submodule the hard way" for
+  c-ares, and installs a patched version of generate_cc.bzl.
+* Rename repository @com_github_google_protobuf to @com_google_protobuf.
+* Rename repository @com_github_grpc_grpc to @com_google_grpc.
+* Rename repository @gtest to @com_google_googletest.
+* Updated grpc/grpc to 1.6.1.
+* Updated madler/zlib to 1.2.11.
+* Updated boringssl to master-with-bazel Sep 2 2017.
+* Updated nuget deps to 1.6.0.
+* Adding binding to //external:protocol_compiler (that's what with grpc repo wants).
+* Remove binding //external:protoc (now //external:protocol_compiler).
+* Migrated all git_repository repository_rules to http_archive
+  (faster).
+
+## v0.7.2 (Fri Jul 14 2017)
+
+* Updated boringssl to latest chromium-stable (@pcj)
+* Updated grpc-java to 1.4.0 (@zhexuany)
+* Fixed broken links in README (@mikesamuel)
+* Improve gogo{fast,faster,slick}_proto_compile (@timpalpant)
+* Support grpc_gateway 1.2 (@pcj)
+* Improved grpc_gateway documentation (@prestonvanloon)
+* Update grpc go t0 1.2.1 (@clownpriest)
+* Overall documentation improvments (@cheister)
+* Fixed require bug (@raraujosc)
+* Upgrade gogo deps (@geeknoid)
+* Java documentation improvements (@bzz)
+* Add support for gogofast, gogofaster, and gogoslick (@douglas-reid)
+* Add -request_context option to grpc_gateway_library (@pcj)
+* Automatically export //java:grpc_compiletime_deps (@perezd)
+* Add importmap to gogo_proto_library (@gsf)
+* Documentation improvments (@Maverick-Crank-GRey)
+* Improved python support (Nikos Michalakis)
+* README update (@wiktortomczak)

DEPENDENCIES.md

@@ -0,0 +1,102 @@
+# Language dependencies for rules_protobuf
+To update this list, `bazel build @org_pubref_rules_protobuf//:deps && cp bazel-bin/DEPENDENCIES.md .`
+
+## Protobuf
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [http_archive](https://docs.bazel.build/versions/master/be/workspace.html#http_archive) | **`@com_google_protobuf`** | [sha256:e83ee63eccfb](https://github.com/google/protobuf/archive/2807436cd828a526c5c38dd235c0d0d9cdc67b1f.zip) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protoc`** | `//external:protoc` (`@com_google_protobuf//:protoc`) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protocol_compiler`** | `//external:protocol_compiler` (`@com_google_protobuf//:protoc`) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protobuf`** | `//external:protobuf` (`@com_google_protobuf//:protobuf`) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protobuf_clib`** | `//external:protobuf_clib` (`@com_google_protobuf//:protoc_lib`) |
+
+## C++
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [http_archive](https://docs.bazel.build/versions/master/be/workspace.html#http_archive) | **`@com_google_grpc_base`** | [sha256:95ee013fdb60](https://github.com/grpc/grpc/archive/f5600e99be0fdcada4b3039c0f656a305264884a.zip) |
+| grpc_repository | **`@com_google_grpc`** |  |
+| [new_http_archive](https://docs.bazel.build/versions/master/be/workspace.html#new_http_archive) | **`@com_github_c_ares_c_ares`** | [sha256:ddce8def076a](https://github.com/c-ares/c-ares/archive/7691f773af79bf75a62d1863fd0f13ebf9dc51b1.zip) |
+| [http_archive](https://docs.bazel.build/versions/master/be/workspace.html#http_archive) | **`@boringssl`** | [(no hash provided)](https://boringssl.googlesource.com/boringssl/+archive/74ffd81aa7ec3d0aa3d3d820dbeda934958ca81a.tar.gz) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@libssl`** | `//external:libssl` (`@boringssl//:ssl`) |
+| [new_http_archive](https://docs.bazel.build/versions/master/be/workspace.html#new_http_archive) | **`@com_github_madler_zlib`** | [sha256:1cce3828ec2b](https://github.com/madler/zlib/archive/cacf7f1d4e3d44d871b605da3b647f07d718623f.zip) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@cares`** | `//external:cares` (`@com_google_grpc//third_party/cares:ares`) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@zlib`** | `//external:zlib` (`@com_github_madler_zlib//:zlib`) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@nanopb`** | `//external:nanopb` (`@com_google_grpc//third_party/nanopb`) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protoc_gen_grpc_cpp`** | `//external:protoc_gen_grpc_cpp` (`@com_google_grpc//:grpc_cpp_plugin`) |
+| [http_archive](https://docs.bazel.build/versions/master/be/workspace.html#http_archive) | **`@com_google_googletest`** | [sha256:f87029f64727](https://github.com/google/googletest/archive/7c6353d29a147cad1c904bf2957fd4ca2befe135.zip) |
+
+## Java
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [http_file](https://docs.bazel.build/versions/master/be/workspace.html#http_file) | **`@protoc_gen_grpc_java_linux_x86_64`** | [sha256:4229579f6e2b](https://repo1.maven.org/maven2/io/grpc/protoc-gen-grpc-java/1.6.1/protoc-gen-grpc-java-1.6.1-linux-x86_64.exe) |
+| [http_file](https://docs.bazel.build/versions/master/be/workspace.html#http_file) | **`@protoc_gen_grpc_java_macosx`** | [sha256:9e3515e22e23](https://repo1.maven.org/maven2/io/grpc/protoc-gen-grpc-java/1.6.1/protoc-gen-grpc-java-1.6.1-osx-x86_64.exe) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@junit_junit_4`** | [junit:junit:jar:4.12](http:repo1.maven.org/maven2/junit/junit/jar) (2973d1) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_api_grpc_proto_google_common_protos`** | [com.google.api.grpc:proto-google-common-protos:0.1.9](http:repo1.maven.org/maven2/com/google/api/grpc/proto-google-common-protos/0.1.9) (3760f6) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_code_findbugs_jsr305`** | [com.google.code.findbugs:jsr305:3.0.0](http:repo1.maven.org/maven2/com/google/code/findbugs/jsr305/3.0.0) (5871fb) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_code_gson_gson`** | [com.google.code.gson:gson:2.7](http:repo1.maven.org/maven2/com/google/code/gson/gson/2.7) (751f54) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_errorprone_error_prone_annotations`** | [com.google.errorprone:error_prone_annotations:2.0.11](http:repo1.maven.org/maven2/com/google/errorprone/error_prone_annotations/2.0.11) (3624d8) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_guava_guava`** | [com.google.guava:guava:19.0](http:repo1.maven.org/maven2/com/google/guava/guava/19.0) (6ce200) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_instrumentation_instrumentation_api`** | [com.google.instrumentation:instrumentation-api:0.4.3](http:repo1.maven.org/maven2/com/google/instrumentation/instrumentation-api/0.4.3) (41614a) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_protobuf_protobuf_java`** | [com.google.protobuf:protobuf-java:3.4.0](http:repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.4.0) (b32aba) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@com_google_protobuf_protobuf_java_util`** | [com.google.protobuf:protobuf-java-util:3.3.1](http:repo1.maven.org/maven2/com/google/protobuf/protobuf-java-util/3.3.1) (35d048) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_grpc_grpc_context`** | [io.grpc:grpc-context:1.6.1](http:repo1.maven.org/maven2/io/grpc/grpc-context/1.6.1) (9c52ae) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_grpc_grpc_core`** | [io.grpc:grpc-core:1.6.1](http:repo1.maven.org/maven2/io/grpc/grpc-core/1.6.1) (871c93) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_grpc_grpc_netty`** | [io.grpc:grpc-netty:1.6.1](http:repo1.maven.org/maven2/io/grpc/grpc-netty/1.6.1) (6941e4) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_grpc_grpc_protobuf`** | [io.grpc:grpc-protobuf:1.6.1](http:repo1.maven.org/maven2/io/grpc/grpc-protobuf/1.6.1) (a309df) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_grpc_grpc_protobuf_lite`** | [io.grpc:grpc-protobuf-lite:1.6.1](http:repo1.maven.org/maven2/io/grpc/grpc-protobuf-lite/1.6.1) (124bca) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_grpc_grpc_stub`** | [io.grpc:grpc-stub:1.6.1](http:repo1.maven.org/maven2/io/grpc/grpc-stub/1.6.1) (f32b7a) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_buffer`** | [io.netty:netty-buffer:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-buffer/4.1.14.Final) (71f0a7) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_codec`** | [io.netty:netty-codec:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-codec/4.1.14.Final) (b8573a) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_codec_http`** | [io.netty:netty-codec-http:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-codec-http/4.1.14.Final) (f287b5) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_codec_http2`** | [io.netty:netty-codec-http2:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-codec-http2/4.1.14.Final) (00d2af) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_codec_socks`** | [io.netty:netty-codec-socks:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-codec-socks/4.1.14.Final) (b8d856) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_common`** | [io.netty:netty-common:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-common/4.1.14.Final) (230ff0) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_handler`** | [io.netty:netty-handler:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-handler/4.1.14.Final) (626a48) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_handler_proxy`** | [io.netty:netty-handler-proxy:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-handler-proxy/4.1.14.Final) (9dbedd) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_resolver`** | [io.netty:netty-resolver:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-resolver/4.1.14.Final) (f91e01) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_netty_netty_transport`** | [io.netty:netty-transport:4.1.14.Final](http:repo1.maven.org/maven2/io/netty/netty-transport/4.1.14.Final) (3ed647) |
+| [maven_jar](https://docs.bazel.build/versions/master/be/workspace.html#maven_jar) | **`@io_opencensus_opencensus_api`** | [io.opencensus:opencensus-api:0.5.1](http:repo1.maven.org/maven2/io/opencensus/opencensus-api/0.5.1) (cbd0a7) |
+
+## C#
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [new_nuget_package](https://github.com/bazelbuild/rules_dotnet#new_nuget_package) | **`@nuget_google_protobuf`** | [Google.Protobuf@3.4.0](https://www.nuget.org/packages/Google.Protobuf) |
+| [new_nuget_package](https://github.com/bazelbuild/rules_dotnet#new_nuget_package) | **`@nuget_grpc`** | [Grpc@1.6.0](https://www.nuget.org/packages/Grpc) |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protoc_gen_grpc_csharp`** | `//external:protoc_gen_grpc_csharp` (`@com_google_grpc//:grpc_csharp_plugin`) |
+
+## Go
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@org_golang_google_grpc`** | [google.golang.org/grpc](https://google.golang.org/grpc/) |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@org_golang_google_genproto`** | [google.golang.org/genproto](https://google.golang.org/genproto/) |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@org_golang_x_net`** | [golang.org/x/net](https://golang.org/x/net/) |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@org_golang_x_text`** | [golang.org/x/text](https://golang.org/x/text/) |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@com_github_golang_glog`** | [github.com/golang/glog](https://github.com/golang/glog/) |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@com_github_golang_protobuf`** | [github.com/golang/protobuf](https://github.com/golang/protobuf/) |
+
+## Gogo
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@com_github_gogo_protobuf`** | [github.com/gogo/protobuf](https://github.com/gogo/protobuf/) |
+
+## Grpc Gateway
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@com_github_grpc_ecosystem_grpc_gateway`** | [github.com/grpc-ecosystem/grpc-gateway](https://github.com/grpc-ecosystem/grpc-gateway/) |
+| [new_http_archive](https://docs.bazel.build/versions/master/be/workspace.html#new_http_archive) | **`@com_github_grpc_ecosystem_grpc_gateway_googleapis`** | [sha256:b8426c25492e](https://github.com/grpc-ecosystem/grpc-gateway/archive/f2862b476edcef83412c7af8687c9cd8e4097c0f.zip) |
+| [go_repository](https://github.com/bazelbuild/rules_go#go_repository) | **`@org_golang_google_genproto`** | [google.golang.org/genproto](https://google.golang.org/genproto/) |
+
+## Node
+
+| Rule | Workspace | Detail |
+| ---: | :--- | :--- |
+| [bind](https://docs.bazel.build/versions/master/be/workspace.html#bind) | **`@protoc_gen_grpc_node`** | `//external:protoc_gen_grpc_node` (`@com_google_grpc//:grpc_node_plugin`) |
+| [npm_repository](https://github.com/pubref/rules_node#npm_repository) | **`@npm_protobuf_stack`** | [async@1.5.2](https://npmjs.org/package/async), [google-protobuf@3.1.1](https://npmjs.org/package/google-protobuf), [lodash@4.6.1](https://npmjs.org/package/lodash), [minimist@1.2.0](https://npmjs.org/package/minimist) |
+| [npm_repository](https://github.com/pubref/rules_node#npm_repository) | **`@npm_grpc`** | [grpc@1.0.0](https://npmjs.org/package/grpc) |