opened
michaljancek
username_0
$apps
$apps$app
$apps$app[[1]]
$apps$app[[1]]$id
[1] "application_1520334358289_2223"

$apps$app[[1]]$user
[1] "h50ovwa"

$apps$app[[1]]$name
[1] "sparklyr.Shell"

$apps$app[[1]]$queue
[1] "root.users.h50ovwa"

$apps$app[[1]]$state
[1] "FAILED"

$apps$app[[1]]$finalStatus
[1] "FAILED"

$apps$app[[1]]$progress
[1] 0

$apps$app[[1]]$trackingUI
[1] "History"

$apps$app[[1]]$trackingUrl
[1] "https://node03a.domain.net:8090/cluster/app/application_1520334358289_2223"

$apps$app[[1]]$diagnostics
[1] "Application application_1520334358289_2223 failed 2 times due to AM Container for appattempt_1520334358289_2223_000002 exited with  exitCode: 1\nFor more detailed output, check application tracking page:https://node03a.domain.net:8090/proxy/application_1520334358289_2223/Then, click on links to logs of each attempt.\nDiagnostics: Exception from container-launch.\nContainer id: container_e19_1520334358289_2223_02_000001\nExit code: 1\nStack trace: ExitCodeException exitCode=1: \n\tat org.apache.hadoop.util.Shell.runCommand(Shell.java:601)\n\tat org.apache.hadoop.util.Shell.run(Shell.java:504)\n\tat org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)\n\tat org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:373)\n\tat org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)\n\tat org.apache.hadoop.yarn.server.nodemanager.containerm... <truncated>
```
sparklyr yarn cluster mode fail to connect - httr kerberos authentication
issue
created
DevMui
username_1
I have the same issue. 

According to this, https://stackoverflow.com/questions/26255964/r-negotiate-authentication-with-rcurl-or-httr this would solve the problem.

```
# Fix the following in yarn_client.R

# before
httr::GET(resourceManagerQuery)
# after
httr::GET(resourceManagerQuery, httr::authenticate(":","","gssnegotiate"))

# before
rmResult <- httr::GET(rmQuery)
# after
rmResult <- httr::GET(rmQuery, httr::authenticate(":", "", "gssnegotiate"))
```

After the change, it connects to Spark with Kerberos, however I couldn't copy any tables into Spark. I am using `yarn-client` (which works without any problem) but think it would be nice to have `yarn-cluster`..
comment