Path with single quote and comma

Hi powerShell,

$fileList = dir 'H:\aa.txt','H:\bb.txt'
$newExtension = ".CSV"
$CsvFile = ""
$(foreach ($file in $fileList){
    $CsvFile = ((join-path $file.DirectoryName  $file.BaseName) + $newExtension)
    $CsvFile
})

the output:
H:\aa.CSV
H:\bb.CSV

I want to display output look like this as below:
'H:\aa.CSV','H:\bb.CSV'