Skip to content
This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Bumping version to v2.2.0-kubernetes-0.3.0 #460

Conversation

sahilprasad
Copy link

Bumping shuffle and resource staging server versions in config files and docs as per #457. Let me know if I missed anything!

CC @erikerlandson

@liyinan926
Copy link
Member

LGTM.

@liyinan926 liyinan926 merged commit dca9b04 into apache-spark-on-k8s:branch-2.2-kubernetes Aug 24, 2017
ifilonenko pushed a commit to ifilonenko/spark that referenced this pull request Feb 26, 2019
## Upstream SPARK-XXXXX ticket and PR link (if not applicable, explain)

Not filed in upstream, touches code for conda.

## What changes were proposed in this pull request?

rLibDir contains a sequence of possible paths for the SparkR package on the executor and is passed on to the R daemon with the SPARKR_RLIBDIR environment variable. This PR filters rLibDir for paths that exist before setting SPARKR_RLIBDIR, retaining existing functionality to preferentially choose a YARN or local SparkR install over conda if both are present.

See daemon.R: https://github.com/palantir/spark/blob/master/R/pkg/inst/worker/daemon.R#L23

Fixes apache-spark-on-k8s#456 

## How was this patch tested?

Manually testing cherry picked on older version

Please review http://spark.apache.org/contributing.html before opening a pull request.
ifilonenko pushed a commit to ifilonenko/spark that referenced this pull request Feb 26, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants