base on <p align="center"> <br> <img src="https://github.com/am15h/tflite_flutter_plugin/raw/update_readme/docs/tflite_flutter_cover.png"/> </br> </p> <p align="center"> <a href="https://flutter.dev"> <img src="https://img.shields.io/badge/Platform-Flutter-02569B?logo=flutter" alt="Platform" /> </a> <a href="https://pub.dartlang.org/packages/tflite_flutter"> <img src="https://img.shields.io/pub/v/tflite_flutter.svg" alt="Pub Package" /> </a> <a href="https://pub.dev/documentation/tflite_flutter/latest/tflite_flutter/tflite_flutter-library.html"> <img alt="Docs" src="https://readthedocs.org/projects/hubdb/badge/?version=latest"> </a> <a href="https://opensource.org/licenses/Apache-2.0"><img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg"></a> </a> </p> ## Announcement Update: 26 April, 2023 This repo is a TensorFlow managed fork of the [tflite_flutter_plugin](https://github.com/am15h/tflite_flutter_plugin) project by the amazing Amish Garg. The goal of this project is to support our Flutter community in creating machine-learning backed apps with the TensorFlow Lite framework. This project is currently a work-in-progress as we update it to create a working plugin that meets the latest and greatest Flutter and TensorFlow Lite standards. That said, *pull requests and contributions are more than welcome* and will be reviewed by TensorFlow or Flutter team members. We thank you for your understanding as we make progress on this update. Feel free to reach out to us by posting in the issues or discussion areas. Thanks! - PaulTR ## Overview TensorFlow Lite Flutter plugin provides a flexible and fast solution for accessing TensorFlow Lite interpreter and performing inference. The API is similar to the TFLite Java and Swift APIs. It directly binds to TFLite C API making it efficient (low-latency). Offers acceleration support using NNAPI, GPU delegates on Android, Metal and CoreML delegates on iOS, and XNNPack delegate on Desktop platforms. ## Key Features - Multi-platform Support for Android and iOS - Flexibility to use any TFLite Model. - Acceleration using multi-threading. - Similar structure as TensorFlow Lite Java API. - Inference speeds close to native Android Apps built using the Java API. - Run inference in different isolates to prevent jank in UI thread. ## (Important) Initial setup : Add dynamic libraries to your app ### Android & iOS Examples and support now support dynamic library downloads! iOS samples can be run with the commands `flutter build ios` & `flutter install ios` from their respective iOS folders. Android can be run with the commands `flutter build android` & `flutter install android` while devices are plugged in. Note: This requires a device with a minimum API level of 26. Note: TFLite may not work in the iOS simulator. It's recommended that you test with a physical device. When creating a release archive (IPA), the symbols are stripped by Xcode, so the command `flutter build ipa` may throw a `Failed to lookup symbol ... symbol not found` error. To work around this: 1. In Xcode, go to **Target Runner > Build Settings > Strip Style** 2. Change from **All Symbols** to **Non-Global Symbols** ### MacOS For MacOS a TensorFlow Lite dynamic library needs to be added to the project manually. For this, first a `.dylib` needs to be built. You can follow the [Bazel build guide](https://www.tensorflow.org/lite/guide/build_arm) or the [CMake build guide](https://www.tensorflow.org/lite/guide/build_cmake) to build the libraries. **CMake Note:** - cross compiling in CMake can be achieved using: `-DCMAKE_OSX_ARCHITECTURES=x86_64|arm64` - bundling two architectures (arm / x86) using lipo: `lipo -create arm64/libtensorflowlite_c.dylib x86/libtensorflowlite_c.dylib -output libtensorflowlite_c.dylib` As a second step, the library needs to be added to your application's XCode project. For this, you can follow the step 1 and 2 of the [official Flutter guide on adding dynamic libraries](https://docs.flutter.dev/platform-integration/macos/c-interop#compiled-dynamic-library-macos). ### Linux For Linux a TensorFlow Lite dynamic library needs to be added to the project manually. For this, first a `.so` needs to be built. You can follow the [Bazel build guide](https://www.tensorflow.org/lite/guide/build_arm) or the [CMake build guide](https://www.tensorflow.org/lite/guide/build_cmake) to build the libraries. As a second step, the library needs to be added to your application's project. This is a simple procedure 1. Create a folder called `blobs` in the top level of your project 2. Copy the `libtensorflowlite_c-linux.so` to this folder 3. Append following lines to your `linux/CMakeLists.txt` ``` Make ... # get tf lite binaries install( FILES ${PROJECT_BUILD_DIR}/../blobs/libtensorflowlite_c-linux.so DESTINATION ${INSTALL_BUNDLE_DATA_DIR}/../blobs/ ) ``` ### Windows For Windows a TensorFlow Lite dynamic library needs to be added to the project manually. For this, first a `.dll` needs to be built. You can follow the [Bazel build guide](https://www.tensorflow.org/lite/guide/build_arm) or the [CMake build guide](https://www.tensorflow.org/lite/guide/build_cmake) to build the libraries. As a second step, the library needs to be added to your application's project. This is a simple procedure 1. Create a folder called `blobs` in the top level of your project 2. Copy the `libtensorflowlite_c-win.dll` to this folder 3. Append following lines to your `windows/CMakeLists.txt` ``` Make ... # get tf lite binaries install( FILES ${PROJECT_BUILD_DIR}/../blobs/libtensorflowlite_c-win.dll DESTINATION ${INSTALL_BUNDLE_DATA_DIR}/../blobs/ ) ``` ## TFLite Flutter Helper Library The helper library has been deprecated. New development underway for a replacement at <https://github.com/google/flutter-mediapipe>. Current timeline is to have wide support by the end of August, 2023. ## Import ```dart import 'package:tflite_flutter/tflite_flutter.dart'; ``` ## Usage instructions ### Import the libraries In the dependency section of `pubspec.yaml` file, add `tflite_flutter: ^0.10.1` (adjust the version accordingly based on the latest release) ### Creating the Interpreter - **From asset** Place `your_model.tflite` in `assets` directory. Make sure to include assets in `pubspec.yaml`. ```dart final interpreter = await Interpreter.fromAsset('assets/your_model.tflite'); ``` Refer to the documentation for info on creating interpreter from buffer or file. ### Performing inference - **For single input and output** Use `void run(Object input, Object output)`. ```dart // For ex: if input tensor shape [1,5] and type is float32 var input = [[1.23, 6.54, 7.81, 3.21, 2.22]]; // if output tensor shape [1,2] and type is float32 var output = List.filled(1*2, 0).reshape([1,2]); // inference interpreter.run(input, output); // print the output print(output); ``` - **For multiple inputs and outputs** Use `void runForMultipleInputs(List<Object> inputs, Map<int, Object> outputs)`. ```dart var input0 = [1.23]; var input1 = [2.43]; // input: List<Object> var inputs = [input0, input1, input0, input1]; var output0 = List<double>.filled(1, 0); var output1 = List<double>.filled(1, 0); // output: Map<int, Object> var outputs = {0: output0, 1: output1}; // inference interpreter.runForMultipleInputs(inputs, outputs); // print outputs print(outputs) ``` ### Closing the interpreter ```dart interpreter.close(); ``` ### Asynchronous Inference with `IsolateInterpreter` To utilize asynchronous inference, first create your `Interpreter` and then wrap it with `IsolateInterpreter`. ```dart final interpreter = await Interpreter.fromAsset('assets/your_model.tflite'); final isolateInterpreter = await IsolateInterpreter.create(address: interpreter.address); ``` Both `run` and `runForMultipleInputs` methods of `isolateInterpreter` are asynchronous: ```dart await isolateInterpreter.run(input, output); await isolateInterpreter.runForMultipleInputs(inputs, outputs); ``` By using `IsolateInterpreter`, the inference runs in a separate isolate. This ensures that the main isolate, responsible for UI tasks, remains unblocked and responsive. ## Contribute to this package This package is managed using [melos](https://pub.dev/packages/melos). Before starting to work on the project, make sure to run the bootstrap command. ```sh dart pub global activate melos # Install or activate melos globally melos bootstrap # Initialize the workspace and bootstrap the package ``` ### Generated code This package uses [ffigen](https://pub.dev/packages/ffigen) to generate FFI bindings. To run code generation, you can use the following melos command: ```sh melos run ffigen ``` ", Assign "at most 3 tags" to the expected json: {"id":"10915","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"