Submit Spark/PySpark jobs via using run configurations in your IDE.
Monitor Spark jobs from the IDE.
The Spark plugin will automatically install the Metastore Core and Remote File Systems plugins. The Remote File Systems plugin lets you connect to remote storages, and Metastore Core lets you connect to:
- AWS Glue
- AWS EMR
- Dataproc
- Hive Metastore
- Hadoop YARN
This plugin is a part of the Big Data Tools plugin bundle.