Quantum Frequency Conversion (QFC) is widely recognized as one of the essential technologies for realizing quantum internet and quantum interconnects that link diverse quantum systems. In this study, we propose a QFC method that selectively converts photons within specific frequency bins from frequency-multiplexed photons in the telecommunication wavelength band, utilizing sum-frequency generation in a cavity that is resonant only with the converted mode. We demonstrate this technique experimentally using laser light. This methodology is expected to contribute significantly to the implementation of frequency-multiplexed quantum networks.