Add support for minor version incremental increase for pyspark (#5366)
* Add support for minor version incremental increase for pyspark in Databricks
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>
* simplify the logic per PR feedback
Signed-off-by: Ben Wilson <benjamin.wilson@databricks.com>