I would think a digital sample and hold module would be the ticket for this. You need a sample and hold circuit that will stay accurate for a long time.

With that, your panning position should hold until you choose to update it. Trigger the sample and hold circuit again to update the signal to whatever your current incoming value is.

-- Ronin1973

That's a great idea, thanks.