At the site - See the job search selection that's right for you

Scheduling within an application inside a given spark application (sparkcontext instance), multiple parallel jobs can run simultaneously if they were submitted from separate threads. by %22job%22, in this section, we mean a spark action (e.g. save , colle

By %22job%22, in this section, we mean a spark action (e.g. save , collect) and any tasks that need to run to evaluate that action. spark%27s scheduler is fully thread-safe and supports this use case to enable applications that serve multiple requests (e.