When using Spark to synchronize data, such as reading data from MySQL and writing it into a Hive table, two resources (pods) are required: the driver and the executor. If the executor value is 1, it is possible to combine the driver and the executor within the same JVM, requiring only one pod, which can save half of the cost.
When using Spark to synchronize data, such as reading data from MySQL and writing it into a Hive table, two resources (pods) are required: the driver and the executor. If the executor value is 1, it is possible to combine the driver and the executor within the same JVM, requiring only one pod, which can save half of the cost.