在Craig McQueen的帮助下,我创建了一个概念验证程序。
该程序播放一个名为“music.wav”的单声道wav 文件(与程序位于同一文件夹中)并显示一个短而宽的窗口。当您在窗口中单击并拖动时,音乐的音高会发生变化。窗口左侧低两个八度,右侧高两个八度。
这里有一些奇怪的行为,我不知道如何解决。如果音调当前很低,那么在音调改变之前大约有 2 秒的延迟。但是,对于高音,音高会实时变化。(随着音高变低,延迟平滑增加)。如果soundOutput.getLeft() < 0.2
. 也就是说,如果缓冲区上剩余的声音量小于0.2秒。因此,不应有任何延误。为了进行故障排除,我包含了写入soundOutput.getLeft()
文件的代码。它往往始终保持在或非常接近于 0。
减少读取的帧以waveRead.readframes(100)
减少延迟,但也会使声音断断续续。增加读取的帧数会显着增加延迟。
import os, sys, wave, pygame, numpy, pymedia.audio.sound, scikits.samplerate
class Window:
def __init__(self, width, height, minOctave, maxOctave):
"""
width, height: the width and height of the screen.
minOctave, maxOctave: the highest and lowest pitch changes. 0 is no change.
"""
self.minOctave = minOctave
self.maxOctave = maxOctave
self.width = width
self.mouseDown = False
self.ratio = 1.0 # The resampling ratio
waveRead = wave.open(os.path.join(sys.path[0], "music.wav"), 'rb')
sampleRate = waveRead.getframerate()
channels = waveRead.getnchannels()
soundFormat = pymedia.audio.sound.AFMT_S16_LE
soundOutput = pymedia.audio.sound.Output(sampleRate, channels, soundFormat)
pygame.init()
screen = pygame.display.set_mode((width, height), 0)
screen.fill((255, 255, 255))
pygame.display.flip()
fout = open(os.path.join(sys.path[0], "musicdata.txt"), 'w') # For troubleshooting
byteString = waveRead.readframes(1000) # Read at most 1000 samples from the file.
while len(byteString) != 0:
self.handleEvent(pygame.event.poll()) # This does not wait for an event.
fout.write(str(soundOutput.getLeft()) + "\n") # For troubleshooting
if soundOutput.getLeft() < 0.2: # If there is less than 0.2 seconds left in the sound buffer.
array = numpy.fromstring(byteString, dtype=numpy.int16)
byteString = scikits.samplerate.resample(array, self.ratio, "sinc_fastest").astype(numpy.int16).tostring()
soundOutput.play(byteString)
byteString = waveRead.readframes(500) # Read at most 500 samples from the file.
waveRead.close()
return
def handleEvent(self, event):
if event.type == pygame.QUIT or (event.type == pygame.KEYUP and event.key == pygame.K_ESCAPE):
sys.exit()
if event.type == pygame.MOUSEBUTTONDOWN and event.button == 1:
self.mouseDown = True
self.setRatio(event.pos)
if event.type == pygame.MOUSEBUTTONUP and event.button == 1:
self.mouseDown = False
if event.type == pygame.MOUSEMOTION and self.mouseDown:
self.setRatio(event.pos)
return None
def setRatio(self, point):
self.ratio = 2 ** -(self.minOctave + point[0] * (self.maxOctave - self.minOctave) / float(self.width))
print(self.ratio)
def main():
Window(768, 100, -2.0, 2.0)
if __name__ == '__main__':
main()
尝试让我使用的所有软件包很好地协同工作是一件痛苦的事。我使用Python 2.6.6, Python 2.6 使用 PyGame 1.9.1 , python 2.6使用NumPy 1.3.0 , python 2.6使用PyMedia 1.3.7.3 , python 2.6使用scikits.samplerate 0.3.1。请注意,scikits.samplerate 与 NumPy 1.4 或更高版本冲突,其中一个包(我忘记是哪个包)需要setuptools