Inorganic-organic composites find extensive application in various fields, including electronic devices and light-emitting diodes. Notably, encapsulation technologies are employed to shield electronic devices (such as printed circuit boards and batteries) from stress and moisture exposure while maintaining electrical insulation. Polymer composites can be used as encapsulation materials because of their controllable mechanical and electrical properties. In this study, we propose a polymer composite that provides good electrical insulation and enhanced mechanical properties. This is achieved by using aluminum borate nanowhiskers (ABOw), which are fabricated using a facile synthesis method. The ABOw fillers are created via a hydrothermal method using aluminum chloride and boric acid. We confirm that the synthesis occurs in various morphologies based on the molar ratio. Specifically, nanowhiskers are synthesized at a molar ratio of 1:3 and used as fillers in the composite. The fabricated ABOw/epoxy composites exhibit a 48.5% enhancement in mechanical properties, similar to those of pure epoxy, while maintaining good electrical insulation.