In the mouse visual cortex, parvalbumin-positive (PV+) inhibitory neurons exhibit precise synaptic strength tuning based on the similarity of their responses to visual stimuli. PV+ neurons strongly inhibit pyramidal neurons that provide them with strong excitation and share similar visual selectivity. This structured inhibitory connectivity stabilizes activity within feature-specific excitatory ensembles while supporting competition between them. PV+ neurons are broadly tuned to visual stimuli, showing less selectivity than pyramidal neurons. However, their responses are functionally heterogeneous, with individual PV+ neurons showing overlapping responses with different nearby pyramidal neurons, indicating functional affiliation with different excitatory subpopulations. Response similarity between PV+ and pyramidal neurons predicts the strength of their synaptic connections. This pattern of tuned but broad inhibitory connectivity recapitulates in vivo observations, including co-tuning of excitatory and inhibitory inputs and competition between ensembles of differentially tuned pyramidal cells. Network simulations demonstrate that specific inhibitory connectivity supports neuronal competition and stabilizes recurrent networks. These findings suggest that the organization of PV+ neuron connections is governed by the similarity of their visual responses, providing a mechanism for tuned inhibition in the visual cortex.In the mouse visual cortex, parvalbumin-positive (PV+) inhibitory neurons exhibit precise synaptic strength tuning based on the similarity of their responses to visual stimuli. PV+ neurons strongly inhibit pyramidal neurons that provide them with strong excitation and share similar visual selectivity. This structured inhibitory connectivity stabilizes activity within feature-specific excitatory ensembles while supporting competition between them. PV+ neurons are broadly tuned to visual stimuli, showing less selectivity than pyramidal neurons. However, their responses are functionally heterogeneous, with individual PV+ neurons showing overlapping responses with different nearby pyramidal neurons, indicating functional affiliation with different excitatory subpopulations. Response similarity between PV+ and pyramidal neurons predicts the strength of their synaptic connections. This pattern of tuned but broad inhibitory connectivity recapitulates in vivo observations, including co-tuning of excitatory and inhibitory inputs and competition between ensembles of differentially tuned pyramidal cells. Network simulations demonstrate that specific inhibitory connectivity supports neuronal competition and stabilizes recurrent networks. These findings suggest that the organization of PV+ neuron connections is governed by the similarity of their visual responses, providing a mechanism for tuned inhibition in the visual cortex.