Fix for when prompt contains an odd num of apostrophes (#4660)
The apostrophes in args.user_args are mixed with the single quotes used
to enclose x in the parsing code.
For example,
`deepspeed --num_nodes 1 --num_gpus 8 --no_local_rank run_generation.py
--model_name_or_path tiiuae/falcon-40b --max_new_tokens 128 --prompt
"I'm a student"`
instead of (which doesn't work):
`deepspeed --num_nodes 1 --num_gpus 8 --no_local_rank run_generation.py
--model_name_or_path tiiuae/falcon-40b --max_new_tokens 128 --prompt
'I'm a student'`
To resolve this issue, we can make a change to enclose x in double
quotes instead of single quotes.
Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>