Databricks GPU clusters clusters support low-level CUDA development using Java libraries such as JCuda.

Install JCuda using an init script

Databricks recommends using Init Scripts to install JCuda to make it available on all cluster nodes.

Launch a GPU enabled cluster with the preloaded Nvidia Libraries and use the notebook below to install an init script that attaches pre-built JCuda libraries to the GPU enabled cluster.

Please check out http://www.jcuda.org for details.

Use JCuda on a single node

This tutorial is inspired by the classic Pi Estimation example at http://spark.apache.org/examples.html