Jones has also announced her Spring 2024 North American tour dates which kick off May 6 in Boston