TensorFlow was designed with mobile and embedded platforms in mind. We have sample code and build support you can try now for these platforms:
Android iOS Raspberry Pi
Appreciated work by MindRocks