Many nanomaterials can be used as sensors or transducers in biomedical research and they form the essential components of transformative novel biotechnologies. In this study, we present an all-optical method for tetherless remote control of neural activity using fully implantable micro-devices based on upconversion technology. Upconversion nanoparticles (UCNPs) were used as transducers to convert near-infrared (NIR) energy to visible light in order to stimulate neurons expressing different opsin proteins. In our setup, UCNPs were packaged in a glass micro-optrode to form an implantable device with superb long-term biocompatibility. We showed that remotely applied NIR illumination is able to reliably trigger spiking activity in rat brains. In combination with a robotic laser projection system, the upconversion-based tetherless neural stimulation technique was implemented to modulate brain activity in various regions, including the striatum, ventral tegmental area, and visual cortex. Using this system, we were able to achieve behavioral conditioning in freely moving animals. Notably, our microscale device was at least one order of magnitude smaller in size (∼100 μm in diameter) and two orders of magnitude lighter in weight (less than 1 mg) than existing wireless optogenetic devices based on light-emitting diodes. This feature allows simultaneous implantation of multiple UCNP-optrodes to achieve modulation of brain function to control complex animal behavior. We believe that this technology not only represents a novel practical application of upconversion nanomaterials, but also opens up new possibilities for remote control of neural activity in the brains of behaving animals.