16 February 2024 | Jintao Fu, Changbin Nie, Feiying Sun, Gengli Li, Haofei Shi, Xingzhan Wei
A bionic visual-audio photodetector (VAPD) is introduced, which integrates visual and auditory perception with on-chip signal preprocessing. Inspired by the human sensory system, the VAPD is based on a vertically stacked graphene-germanium (Gra-Ge) hybrid field-effect phototransistor. This device can detect both light and sound waves, enabling "watching" and "listening" within a single unit. The gate-tunable positive, negative, and zero photoresponses allow for highly programmable responsivities, enabling diverse functions such as visual feature extraction, object classification, and sound wave manipulation. The device exhibits excellent responsivity and operation speed, making it suitable for capturing light source changes triggered by acoustic vibrations. The gate-programmable photoresponse also extends the device's versatility to preprocess visual images and execute target recognition tasks, as well as modulate sound wave intensity. The all-in-one device architecture simplifies hardware and offers a promising alternative for developing intelligent and compact sensor systems. The VAPD demonstrates bidirectional photoresponse characteristics, with the ability to detect and process visual and auditory signals. It can perform visual signal reception and preprocessing, including edge enhancement and image processing operations. The device is also capable of auditory signal acquisition and modulation, demonstrating its potential in constructing convolutional neural networks for target recognition. The VAPD shows high performance in terms of photodetection, with a maximum specific detectivity of 2.4 × 10¹⁰ cm·Hz¹/²/W under blackbody radiation. The device is also capable of classifying letters with high accuracy, demonstrating its potential in constructing classification convolutional neural networks. The VAPD is also used for acoustic signal detection and modulation, showing its ability to capture sound waves and reproduce audio signals. The device is a promising component for neuromorphic sensors and optoelectronic devices.A bionic visual-audio photodetector (VAPD) is introduced, which integrates visual and auditory perception with on-chip signal preprocessing. Inspired by the human sensory system, the VAPD is based on a vertically stacked graphene-germanium (Gra-Ge) hybrid field-effect phototransistor. This device can detect both light and sound waves, enabling "watching" and "listening" within a single unit. The gate-tunable positive, negative, and zero photoresponses allow for highly programmable responsivities, enabling diverse functions such as visual feature extraction, object classification, and sound wave manipulation. The device exhibits excellent responsivity and operation speed, making it suitable for capturing light source changes triggered by acoustic vibrations. The gate-programmable photoresponse also extends the device's versatility to preprocess visual images and execute target recognition tasks, as well as modulate sound wave intensity. The all-in-one device architecture simplifies hardware and offers a promising alternative for developing intelligent and compact sensor systems. The VAPD demonstrates bidirectional photoresponse characteristics, with the ability to detect and process visual and auditory signals. It can perform visual signal reception and preprocessing, including edge enhancement and image processing operations. The device is also capable of auditory signal acquisition and modulation, demonstrating its potential in constructing convolutional neural networks for target recognition. The VAPD shows high performance in terms of photodetection, with a maximum specific detectivity of 2.4 × 10¹⁰ cm·Hz¹/²/W under blackbody radiation. The device is also capable of classifying letters with high accuracy, demonstrating its potential in constructing classification convolutional neural networks. The VAPD is also used for acoustic signal detection and modulation, showing its ability to capture sound waves and reproduce audio signals. The device is a promising component for neuromorphic sensors and optoelectronic devices.