React Native On-Device Machine Learning w/ Google ML Kit

Overview
Comments
  • App crash after installing the package in android

    App crash after installing the package in android

    What happened?

    I insalled the package using npm like this npm install @react-native-ml-kit/image-labeling --save

    It is making the app crash. The I tried to link the main branch directly to package,json like this "@react-native-ml-kit/image-labeling": "https://github.com/a7med-mahmoud/react-native-ml-kit/tree/main/image-labeling#main",

    That doesn't event install

    Version

    1.2.0

    Which ML Kit packages do you use?

    • [ ] @react-native-ml-kit/barcode-scanning
    • [ ] @react-native-ml-kit/face-detection
    • [ ] @react-native-ml-kit/identify-languages
    • [X] @react-native-ml-kit/image-labeling
    • [ ] @react-native-ml-kit/text-recognition
    • [ ] @react-native-ml-kit/translate-text

    What platforms are you seeing this issue on?

    • [X] Android
    • [X] iOS

    System Information

    System: OS: Windows 10 10.0.22000 CPU: (8) x64 11th Gen Intel(R) Core(TM) i7-11370H @ 3.30GHz Memory: 3.95 GB / 15.74 GB Binaries: Node: 16.15.0 - C:\Program Files\nodejs\node.EXE Yarn: 1.22.18 - C:\Program Files\nodejs\yarn.CMD npm: 8.5.5 - C:\Program Files\nodejs\npm.CMD Watchman: Not Found SDKs: Android SDK: Not Found Windows SDK: Not Found IDEs: Android Studio: Version 2021.1.0.0 AI-211.7628.21.2111.8193401 Visual Studio: Not Found Languages: Java: 11.0.15.1 - C:\Program Files\Common Files\Oracle\Java\javapath\javac.EXE npmPackages: @react-native-community/cli: Not Found react: 18.0.0 => 18.0.0 react-native: 0.69.4 => 0.69.4 react-native-windows: Not Found npmGlobalPackages: *react-native*: Not Found

    Steps to Reproduce

    Install the package using npm install @react-native-ml-kit/image-labeling --save Try run the project using npm run android

    bug image labeling 
    opened by DeepikaSharma5 18
  • Error while reading content from uri

    Error while reading content from uri

    What happened?

    Error: No content provider:

    Version

    @react-native-ml-kit/barcode-scanning: version@react-native-ml-kit/face-detection: version@react-native-ml-kit/identify-languages: version@react-native-ml-kit/image-labeling: version@react-native-ml-kit/text-recognition: version@react-native-ml-kit/translate-text: version

    Which ML Kit packages do you use?

    • [ ] @react-native-ml-kit/barcode-scanning
    • [ ] @react-native-ml-kit/face-detection
    • [ ] @react-native-ml-kit/identify-languages
    • [ ] @react-native-ml-kit/image-labeling
    • [X] @react-native-ml-kit/text-recognition
    • [ ] @react-native-ml-kit/translate-text

    What platforms are you seeing this issue on?

    • [X] Android
    • [ ] iOS

    System Information

    System: OS: Windows 10 10.0.19045 CPU: (12) x64 Intel(R) Core(TM) i5-10400F CPU @ 2.90GHz Memory: 587.97 MB / 15.88 GB Binaries: Node: 16.10.0 - C:\Program Files\nodejs\node.EXE Yarn: 1.22.19 - ~\AppData\Roaming\npm\yarn.CMD npm: 7.24.0 - C:\Program Files\nodejs\npm.CMD Watchman: Not Found SDKs: Android SDK: API Levels: 31, 33 Build Tools: 30.0.3, 31.0.0, 33.0.0 System Images: android-31 | Google Play Intel x86 Atom_64, android-33 | Google APIs Intel x86 Atom_64 Android NDK: Not Found Windows SDK: Not Found IDEs: Android Studio: AI-213.7172.25.2113.9123335 Visual Studio: Not Found Languages: Java: 11.0.17 - /c/Program Files/Eclipse Adoptium/jdk-11.0.17.8-hotspot/bin/javac npmPackages: @react-native-community/cli: Not Found react: 18.1.0 => 18.1.0 react-native: 0.70.5 => 0.70.5 react-native-windows: Not Found npmGlobalPackages: react-native: Not Found

    Steps to Reproduce

    install react native mlkit and try to recognize text in android emulator

    async function recognizeText() { try { const result = await TextRecognition.recognize( "https://developers.google.com/static/ml-kit/vision/text-recognition/images/Wege_der_parlamentarischen_Demokratie.jpg" );

      console.log("A", JSON.stringify(result, null, 2));
    
      for (let block of result.blocks) {
        console.log("Block text:", block.text);
        console.log("Block frame:", block.frame);
    
        for (let line of block.lines) {
          console.log("Line text:", line.text);
          console.log("Line frame:", line.frame);
        }
      }
    
      // resultFromFile.map(item => {
      //   item.lines
      // });
    
      setText(result.text);
    } catch (err) {
      console.log("Error", err);
    }
    

    }

    bug 
    opened by gustavo867 17
  • iOS cocoapods versions

    iOS cocoapods versions

    I'm trying to run pod install, and I'm getting the following error. Any help?

    [!] CocoaPods could not find compatible versions for pod "GoogleMLKit/MLKitCore":
      In Podfile:
        RNMLKitFaceDetection (from `../node_modules/@react-native-ml-kit/face-detection`) was resolved to 1.1.1, which depends on
          GoogleMLKit/FaceDetection (= 2.6.0) was resolved to 2.6.0, which depends on
            GoogleMLKit/MLKitCore (= 2.6.0)
    
        RNMLKitTextRecognition (from `../node_modules/@react-native-ml-kit/text-recognition`) was resolved to 1.1.1, which depends on
          GoogleMLKit/TextRecognition (= 2.2.0) was resolved to 2.2.0, which depends on
            GoogleMLKit/MLKitCore (= 2.2.0)
    
    opened by wilav-dev 5
  • Plugin with id 'maven' not found.

    Plugin with id 'maven' not found.

    I'm getting the following error:

    `* What went wrong: A problem occurred evaluating project ':react-native-ml-kit_face-detection'.

    Plugin with id 'maven' not found. `

    opened by wilav-dev 3
  • some barcode decoding problems

    some barcode decoding problems

    What happened?

    First : very good, problems free and light to compile package, congrats !

    I went far in the barcode decoding and mention some problems :

    • Seems to not take all the codes when mixed on a same picture : ex 128 codes (format 1) and format 16 : the app do not consider the 16 format (Datamatrix)

    1D and 2 D codes mixed : depending the 1st the app will find , will not mix : so either he decodes only the 1D or only the 2D

    (tools : https://barcode.tec-it.com/en , I remains at your disposal for testing improvments !

    Version

    @react-native-ml-kit/barcode-scanning: V1.2.0 30-codes-feuille.pdf

    Which ML Kit packages do you use?

    30-codes-feuille.pdf

    • [X] @react-native-ml-kit/barcode-scanning
    • [ ] @react-native-ml-kit/face-detection
    • [ ] @react-native-ml-kit/identify-languages
    • [ ] @react-native-ml-kit/image-labeling
    • [ ] @react-native-ml-kit/text-recognition
    • [ ] @react-native-ml-kit/translate-text

    What platforms are you seeing this issue on?

    • [X] Android
    • [ ] iOS

    System Information

    System: OS: Windows 10 10.0.19043 CPU: (4) x64 Intel(R) Core(TM) i5-3320M CPU @ 2.60GHz Memory: 1.53 GB / 7.70 GB Binaries: Node: 16.14.1 - C:\Program Files\nodejs\node.EXE Yarn: 1.22.19 - ~\AppData\Roaming\npm\yarn.CMD npm: 8.13.1 - C:\Program Files\nodejs\npm.CMD Watchman: Not Found SDKs: Android SDK: Not Found Windows SDK: AllowDevelopmentWithoutDevLicense: Enabled AllowAllTrustedApps: Enabled IDEs: Android Studio: Not Found Visual Studio: Not Found Languages: Java: Not Found npmPackages: @react-native-community/cli: Not Found react: 18.1.0 => 18.1.0 react-native: 0.70.1 => 0.70.1 react-native-windows: Not Found npmGlobalPackages: react-native: Not Found

    Steps to Reproduce

    just select the images given in th example given.

    "dependencies": { "@react-native-ml-kit/barcode-scanning": "^1.2.0", "react": "18.1.0", "react-native": "0.70.1", "react-native-image-crop-picker": "^0.38.0", "react-native-keyboard-aware-scroll-view": "^0.9.5" }, yarn yarn run-android (no more need to link)

    thanks !

    bug 
    opened by Productivix 2
  • BUILD FAILED on IOS

    BUILD FAILED on IOS

    using on M1 Mac

    Failed to build iOS project. We ran "xcodebuild" command but it exited with error code 65. To debug build logs further, consider building your app with Xcode.app, by opening mustaqbill.xcworkspace. Command line invocation: /Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild -workspace mustaqbill.xcworkspace -configuration Debug -scheme mustaqbill -destination id=12D92B4A-96CD-4871-96FD-9C0A5B7FD54C

    User defaults from command line: IDEPackageSupportUseBuiltinSCM = YES

    note: Using new build system note: Planning Analyze workspace

    Create build description Build description signature: f4aa7eb76e1c41b541f9b546ae266813 Build description path: /Users/talhaatiq/Library/Developer/Xcode/DerivedData/mustaqbill-fhemmipxsgoadjbxflibshapgaaz/Build/Intermediates.noindex/XCBuildData/f4aa7eb76e1c41b541f9b546ae266813-desc.xcbuild

    note: Build preparation complete note: Building targets in dependency order /Users/talhaatiq/Documents/GitHub/P103-Mstqbl-App/ios/mustaqbill.xcodeproj: error: The linked library 'libPods-mustaqbill.a' is missing one or more architectures required by this target: x86_64. (in target 'mustaqbill' from project 'mustaqbill')

    2022-06-29 18:09:26.542 xcodebuild[12083:734655] Requested but did not find extension point with identifier Xcode.IDEKit.ExtensionSentinelHostApplications for extension Xcode.DebuggerFoundation.AppExtensionHosts.watchOS of plug-in com.apple.dt.IDEWatchSupportCore 2022-06-29 18:09:26.542 xcodebuild[12083:734655] Requested but did not find extension point with identifier Xcode.IDEKit.ExtensionPointIdentifierToBundleIdentifier for extension Xcode.DebuggerFoundation.AppExtensionToBundleIdentifierMap.watchOS of plug-in com.apple.dt.IDEWatchSupportCore ** BUILD FAILED **

    opened by taatiq882 2
  • Barcode scan

    Barcode scan

    added a minimal barcode scan implementation using the image labeling implementation as a framework. I've got it up on npm under barcode-scanning right now (username notyet) but wanted commit here as you have a great organizational structure to the mlkit implementations. Right now it just scans all barcodes, and returns an array of objects containing the value and the type of barcode. should be working for android and iOS. If there are any changes needed I'm down to work on them, just let me know.

    opened by s0rta 2
  • Add cornerPoints to text-recognition

    Add cornerPoints to text-recognition

    What's New

    This PR adds the cornerPoints attribute which is present in TextBlock, TextLine, and TextElement. cornerPoints is useful if you want to draw accurate highlights over the block/line/element that follows the perspective in which the photo is taken.

    Reference Documentation

    iOS: https://developers.google.com/ml-kit/reference/ios/mlkittextrecognitioncommon/api/reference/Classes/MLKTextBlock#/c:objc(cs)MLKTextBlock(py)cornerPoints Android: https://developers.google.com/android/reference/com/google/mlkit/vision/text/Text.TextBlock#getCornerPoints()

    Testing

    Built the example app, successfully compiled and ran the app on both iOS and Android, and logged the resulting result and saw that the cornerPoints attribute was indeed present in each block/line/element.

    opened by frw 1
  • Could not find a delaraction file for module `@react-native-ml-kit/text-recognition`

    Could not find a delaraction file for module `@react-native-ml-kit/text-recognition`

    What happened?

    Hi @a7medev, currently I couldn't find declaration files and couldn't import the interface/datatypes. Is there any way for me to import it correctly?

    missing-mlkit-declaration-file

    Version

    @react-native-ml-kit/text-recognition:^1.2.0

    Which ML Kit packages do you use?

    • [ ] @react-native-ml-kit/barcode-scanning
    • [ ] @react-native-ml-kit/face-detection
    • [ ] @react-native-ml-kit/identify-languages
    • [ ] @react-native-ml-kit/image-labeling
    • [X] @react-native-ml-kit/text-recognition
    • [ ] @react-native-ml-kit/translate-text

    What platforms are you seeing this issue on?

    • [X] Android
    • [ ] iOS

    System Information

    System:
        OS: Linux 5.15 Ubuntu 20.04.5 LTS (Focal Fossa)
        CPU: (8) x64 11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz
        Memory: 955.81 MB / 15.33 GB
        Shell: 5.0.17 - /bin/bash
      Binaries:
        Node: 16.13.2 - ~/.nvm/versions/node/v16.13.2/bin/node
        Yarn: 3.2.0 - ~/.nvm/versions/node/v16.13.2/bin/yarn
        npm: 8.19.1 - ~/.nvm/versions/node/v16.13.2/bin/npm
        Watchman: 4.9.0 - /usr/bin/watchman
      SDKs:
        Android SDK:
          API Levels: 25, 26, 27, 28, 29, 30, 31, 32, 33
          Build Tools: 30.0.2, 30.0.3, 31.0.0, 32.0.0, 32.1.0, 33.0.0
          System Images: android-29 | Google APIs Intel x86 Atom_64, android-30 | Google APIs Intel x86 Atom
          Android NDK: Not Found
      IDEs:
        Android Studio: Not Found
      Languages:
        Java: 11.0.16 - /usr/bin/javac
      npmPackages:
        @react-native-community/cli: ^7.0.3 => 7.0.3 
        react: 17.0.2 => 17.0.2 
        react-native: ^0.68.3 => 0.68.3 
      npmGlobalPackages:
        *react-native*: Not Found
    

    Steps to Reproduce

    • Install from yarn, yarn add @react-native-ml-kit/text-recognition
    • Import in .tsx file
    bug 
    opened by j-elmer123 1
  • TextRecognition iOS error

    TextRecognition iOS error

    Hello, I'm getting "Input image must not be nil" on iOS. I'm using RNFS.TemporaryDirectoryPath, also tried RNFS.DocumentDirectoryPath. It's working using Android. Any idea? Should I add some permission or capability?

    IMG_3FC1BDAE7873-1

    opened by wilav-dev 1
  • Update pod dependency for TextRecognition

    Update pod dependency for TextRecognition

    Ensure the same GoogleMLKit version when using multiple packages within the same project. FaceDetection was using 2.3.0 and TextRecognition 2.2.0 which had incompatible GoogleMLKit versions.

    opened by catalinmiron 0
Owner
Ahmed Mahmoud
I do JavaScript things • React (Native) enthusiastic ⚛️
Ahmed Mahmoud
Official React Native client for FingerprintJS PRO. 100% accurate device identification for fraud detection.

FingerprintJS PRO React Native Official React Native module for 100% accurate device identification, created for the FingerprintJS Pro Server API. Thi

FingerprintJS 26 Nov 22, 2022
With react-native-update-in-app library you can easily implement in-app updates in your React Native app using CDN or any other file server

React Native In-App update With react-native-update-in-app library you can easily implement in-app updates in your React Native app using CDN or any o

Nepein Andrey 7 Dec 21, 2022
Google's ML-Kit-Vision demo (android) for pre encoded video.

Android ML Kit Vision demo with Video Google's ML-Kit-Vision demo (android) for pre encoded video. Demos for camera preview and still image are also i

null 17 Dec 29, 2022
On-device wake word detection powered by deep learning.

Porcupine Made in Vancouver, Canada by Picovoice Porcupine is a highly-accurate and lightweight wake word engine. It enables building always-listening

Picovoice 2.8k Jan 7, 2023
React native wrapper for Jitsi Meet SDK Library that rely on the native view (Activity / ViewController)

react-native-jitsi-meet-sdk React native wrapper for Jitsi Meet SDK Library. This Library implements the Jitsi SDK with a native activity on the Andro

null 7 May 2, 2022
An awesome native wheel picker component for React Native.

⛏️ react-native-picky An awesome native wheel picker component for react-native. Features Supports multiple columns ✅ Supports looping ✅ Native Androi

null 28 Dec 4, 2022
This program is a simple machine learning implementation in Java for detecting skin pixels.

Skin Detector ?? ?? Detects human skin from images This program is a simple machine learning implementation in Java for detecting skin pixels. How to

Tasmia Zerin 1 Jan 21, 2022
Share food-Android- - Food donation coded in native android with firebase, google maps api and php server xampp

share_food-Android- Instructions: 1. Create a firebase account and link it with the project via google-services.json. 2. This project also uses a XAMP

Abubakar 3 Dec 28, 2021
Google Oauth2 login scenario with Spring boot + React

spring-react-google-oauth2 Google Oauth2 login scenario with Spring boot + React Below diagram is based on oauth implicit flow. Result How to start Pr

배진우 14 Nov 24, 2022
Tencent Kona JDK17 is a no-cost, production-ready distribution of the Open Java Development Kit (OpenJDK), Long-Term Support(LTS) with quarterly updates.

Tencent Kona JDK17 Tencent Kona JDK17 is a no-cost, production-ready distribution of the Open Java Development Kit (OpenJDK), Long-Term Support(LTS) w

Tencent 59 Nov 30, 2022
The ByteSkript development kit, including resources for third-party libraries that are not contained within the standard runtime.

ByteSkript Development Kit Todo. The development kit is a set of advanced resources available for library creators. These are not available within the

null 1 Jan 8, 2022
GitHub Action to download and install Oracle's Java Development Kit builds

oracle-actions/setup-java This action downloads a Java Development Kit (JDK) built by Oracle and installs it using actions/setup-java. JDKs built by O

Oracle GitHub Actions 43 Dec 15, 2022
The VAST ad sample code provided by HUAWEI Ads Kit describes how to display linear ads by integrating the HUAWEI VAST SDK into your app.

HMS Ads Demo for VAST English | 中文 Table of Contents Introduction Installation Configuration Supported Environments Sample Code Result License Introdu

HMS 11 Jul 16, 2022
Get device location by telephony (SIM card) or settings without using GPS tracker.

react-native-device-country Get device location by telephony (SIM card) or settings without using GPS tracker Installation yarn add react-native-devic

dev.family 46 Nov 29, 2022
Unified Device Tree for Realme X3 series

Unified Device Tree for Realme X3 series The realme X3 (codenamed "RMX2081", "RMX2083") is a high-end smartphone from realme. It was announced and rel

Adithya 5 May 5, 2022
On-device, Offline Spleeter Solution For Mobile

Spleeter for Mobile On-device, Offline Spleeter Solution For Android & iOS Spleeter is Deezer source separation library with pretrained models written

FaceOnLive 235 Dec 24, 2022
[WIP] Device Tree for Redmi K30 Ultra

A buildable device tree for the Redmi K30 Ultra (codenamed "cezanne") written by beginners, borrowing a lot from the RMX3031, chopin, atom and the ori

coolscode 23 Dec 9, 2022
An API Library that provides the functionality to access, manage and store device topologies found in JSON files using Java and Maven Framework

Topology API ?? About An API library which provides the functionality to access, manage and store device topologies. ?? Description Read a topology fr

Abdelrahman Hamdy 2 Aug 4, 2022
Customize your device even more by having two separate sets of wallpapers for light and dark mode.

DualWallpaper You can help me out with translations here. Customize your device even more by having two separate sets of wallpapers for light and dark

Yann 18 Dec 25, 2022