SE Documentation

English

Русский

English

Русский

Appearance

en / smart-id-engine

Smart ID Engine. Recognition of Identity Documents ​

The Smart ID Engine program is designed for recognition of identity documents, such as passports, IDs, driver's licenses, visas, and so on. In total, 2989 types of identification documents from 240 jurisdictions worldwide and 4715 templates in more than 100 languages.

State registration

The Smart ID Engine program is registered in the State Register of Computer Programs 22.06.2020. The certificate of state registration No 2020616758. [1]

The program works in real conditions and in real time with photos, videos and scans. It is possible to recognize a two-page document in one session. The original documents can be submitted at any angle.

The use of the latest GreenOCR® technologies and artificial intelligence developed by our company ensures high recognition confidence. In order to improve quality, we have created ultra-compact, low-bit artificial intelligence models and are continuously improving them, as well as the product itself.

Due to the modular structure of the program, the size of the library is not large. It makes the library suitable for integration with variety of mobile and server systems.

Delivery Package ​

  • API in C, С++, C#, Java, Python, PHP, Javascript/webAssembly;
  • Samples in C/C++/C#/Java/PHP/Python/Javascript;
  • Frameworks: React Native, Flutter;
  • REST API for low-code.

Advantages of Smart ID Engine ​

Information Security ​

No risk of data leakage. All recognition operations are fully automatic and do not impy the human factor. Recognition is performed offline on mobile phones or in the customer's network without manual verification or any operator intervention. No network connection is required to work with our product.

All processing is done in the local RAM of the devices (100% on-premise).

Recognition Quality and Speed ​

High recognition speed on even mobiles of the economy segment.

The result can be obtained at the first attempt, and no user training is required.

High results are possible even at low resolutions (from 100 DPI) and in uneven lighting, in bright light and in the dark, at any shooting angle. The recognition rate is up to 55 documents per second on the server and 0.15 seconds per document on a mobile phone.

Integration Possibilities ​

A wide range of operating systems is supported: Aurora OS, Android, iOS, MS Windows, Linux, Elbrus OS, RED OS, Astra Linux, Atlix OS, Alt Linux Aurora OS, х86, x86/64, ARMv7-v8-v9 (AArch32 and AArch64), MIPS (MIPS32 and MIPS64), Elbrus.

Functionality of Smart ID Engine ​

1. Detection and Recognition
  • Auto selection of document type;
  • Recognition in video sequence (an ordered collection of frames);
  • Recognition of graphic (seals, stamps, logos, etc);
  • Recognition of documents without using ROM (storing temporary and intermediate data on ROM);
  • Recognition and decoding of machine-readable zone (MRZ) in accordance with ISO/ICAO;
  • Recognition of identification cards on both sides with the result on separate pages;
  • Recognition of information without accessing resources external to the device (application servers, online services, etc.);
  • Recognition of typescript text fields in a visually controlled area;
  • Recognition of MRZ in accordance with GOST;
  • Recognition of single-line and multi-line text fields;
  • Recognition of passports in mirror orientation;
  • Recognition of documents positioned at any angle;
  • Recognition of handwritten fields (pages 2 and 3 of the general passport of a citizen of the Russian Federation, information about permanent registration and other stamps from all pages of the passport of a citizen of the Russian Federation, identification of the page number);
  • Recognition of document scans;
  • Recognition of document photos;
  • Recognition of color (RGB) and single-channel (grayscale) images;
  • Recognition of all document fields and parts of the document fields specified in the input parameters;
  • Automatic detection of handwritten fields (pages 2 and 3 of the general passport of a citizen of the Russian Federation, permanent registration information and other stamps from all pages of the passport of a citizen of the Russian Federation, page number detection);
  • Independent recognition of each frame when processing a video sequence;
  • Simultaneous recognition of adjacent document pages (for a number of passports of the CIS countries and other certifying documents of the world);
  • Font-independent recognition of printed text;
  • Preliminary (before text recognition) automatic identification of the document type by its image and recognition of fields of the identified document type.
2. Technological features
  • The ability to control the number of computing threads used;
  • Highlighting non-standard graphic areas of the document;
  • Highlighting specified graphic fields of the document;
  • Return of the "best" image of the document template when processing a video sequence;
  • Return of the "best" photo of the document holder when processing the video sequence;
  • Return of document images, taking into account the masking of the specified fields;
  • Return of individual details for each input image;
  • Support of a wide range of acceptable physical resolution of recognized documents from 100 to 600 dpi and above;
  • NFC chip reading;
  • Parallel configuration;
  • The use of 8-bit and 4-bit deep neural network architectures for recognition of text and graphic elements.
3. Interactivity. Identification and comparison
  • Detecting a photo of a document holder using neural network algorithms;
  • Integration of the results of independent recognition of each frame during video sequence processing;
  • Face comparison;
  • Comparing passport photos with selfies;
  • Verification of document "liveness";
  • Verification of face "liveness";
  • Advanced document scanning in a video stream, allowing the user to follow instructions in real time, see Video authentication.

Computational Document Forensic ​

Smart ID Engine identifies signs that may indicate digital or physical forgery of identity documents. The ability to analyze images obtained by scanning in the ultraviolet and infrared ranges is supported (for all pages of the Russian passport).

The algorithm of forgery detection implements an integrated approach to document analysis involving:

  • detection of interference using image editing software (antiphotoshop);
  • multispectral document checks;
  • checks for holograms;
  • cross-validation of data;
  • checks for document validity and calculation of checksums, neural network analysis of the document form features.

Verification of Document “Liveness” ​

Smart ID Engine detects attempts to use replicas, photocopies, and taking an image of a document using a computer monitor, tablet, or smartphone. The algorithms used to solve this problem detect holographic security elements, special visual security elements (monograms, ornaments, etc.), check the geometry of the form, and monitor the behavior of the document in real-world surveillance conditions in video stream and on separate frames. The “liveness” detector is “passive”. That is, the user does not need to perform special actions when using it.

Verification of Face “Liveness” ​

Smart ID Enginе specifies the “liveness" of a face captured on camera, i.e. proves that there is a living person (and not a dummy) in front of the device.

The check is performed in real time as follows. The screen shows the face of the person the camera is pointing at. After operation is started, a face mask appears on the screen, indicating the expected rotation of the user's head by a certain degree.

Video Authentication ​

The video authentication component provides advanced possibilities of scanning and recognizing identity documents. When you start scanning, instructions are displayed on the screen of your device. Following the instructions, the user performs actions in real time.

Supported File Formats ​

The following file formats are supported:

Pass an image of the special class se.common.image to the system for recognition. You can create it using the following image formats:

  • jpeg, png;
  • tiff (✔️TIFF_LZW, ✔️TIFF_PACKBITS,✔️TIFF_CCITT);
  • base64 (above mentioned formats);
  • file buffer with a preliminary indication of the color scheme, width\height\number of channels.

The maximum allowed image size by default is 15000x15000px. You can change the maximum image size.

Handling a HEIC file

A HEIC file in the mobile SDK are handled similarly to other image formats. The HEIC is read using system tools.

In the server SDK, open the HEIC format using external tools and convert it either to one of the formats we support, or transfer the raw pixels directly as an RGB buffer (this is recommended).

Recognized Documents ​

Smart ID Engine supports recognition of 2989 different types of documents
  • Passports – 193 UN member countries + about 47 additional jurisdictions and document issuing organizations;
  • Identity cards (ID cards) – 200+ countries;
  • Driving licenses – 200+ countries;
  • Visas – 40+ countries;
  • Residence permits – 100+ countries;
  • Vehicle registration certificates – 20+ countries;;
  • Military ID cards – 10+ countries.
Documents of the Russian Federation
  • RF passport:
    • main page (pages 2-3);
    • stamps:
      • registration;
      • deregistration;
      • military authority;
      • marriage registration;
      • marriage deregistration;
      • previous RF passports;
    • detection of all pages of the RF passport and recognition of the passport number on them;
    • sorting registration stamps by date and detection of the actual one;
  • Residence permit for a foregn citizen;
  • Residence permit for a stateless person;
  • Temporary residence permit;
  • Visa;
  • National passport;
  • Driving license;
  • Military card;
  • Temporary identity card;
  • International passport (for 5 years);
  • Biometric international passport (for 10 years);
  • Workshop card;
  • Health permit;
  • Migration card ;
  • Patent;
  • Health insurance;
  • PTS (Vehicle registration document);
  • Temporary residence permit;
  • Firearm permit;
  • Work permif for a foregn citizen or a stateless person;
  • Marriage certificate;
  • Name change certificate;
  • Certificate of registration of a Russian organization with the Tax Authority at its location;
  • Certificate of registration of an individual with the Tax Authority at its location;
  • Certificate of temporary asylum in the territory of the Russian Federation;
  • Conscription certificate;
  • Certificate of consideration of the application for recognition as a refugee in the territory of the Russian Federation;
  • Divorce сertificate;
  • Birth сertificate;
  • Death сertificate;
  • Paternity сertificate;
  • Adoption сertificate;
  • Military deferment сertificate;
  • Official сard of the Ministry of Foreign Affairs of the Russian Federation;
  • SNILS;
  • INN;
  • Disability сertificate;
  • Vehicle registration certificate;
  • Employment record;
  • Lawyer certificate;
  • Refugee certificate;
  • Military ID;
  • Foreigner ID;
  • No citizenship ID;
  • Seafarere's identity;
  • Large family certificate;
  • Certificate of prosecutor's office;
  • Police identity;
  • Certificate of an employee of the Ministry of Defense of the Russian Federation;
  • Driving tractor license;
  • Previous national passports stamps;
  • Registration stamp;
  • Pension certificate;
  • Pension ID;
  • Specialist in welding production certificate (NAKS).
Additional ID Documents of the World
  • Work permits — USA, Singapore, Russian Federation, UAE, Turkey, Cambodia, Maldives, Bermuda, Panama, Philippines, British Virgin Islands, Indonesia;
  • Вirth, death, marriage, divorce, name change, adoption, paternity, disability certificates – Russian Federation, Belarus, Armenia, Azerbaijan, Georgia, Kazakhstan, Kyrgyzstan, Moldova, Ukraine, Uzbekistan;
  • Health insurance card — the USA, France, Canada, Italy, Ghana, Japan, Finland, Brazil, EU, Kenya, Philippines, Taiwan;
  • Seafarer's identity document — Liberia, Panama, Philippines, Poland, Turkey, Bahamas, Antigua and Barbuda, Azerbaijan, Finland, the Russian Federation, the United Kingdom of Great Britain and Northern Ireland;
  • Builder's identity cards — Norway;
  • Doctor’s identity cards — Brazil;
  • Diplomatic ID card — Uruguay;
  • Migration card — Israel, Poland;
  • Taxpayer identification number (TIN) card — Anguilla, Antigua and Barbuda, Brazil, Canada, Fiji, Sierra Leone, Russian Federation;
  • Voter cards — Anguilla, Nigeria, Bermuda, Bhutan, Fiji, Ghana, Liberia, Mozambique, Sierra Leone, Chad, Venezuela, British Virgin Islands, the United Kingdom of Great Britain and Northern Ireland, India;
  • Police identity — Brazil, Austria, Greece;
  • Border crossing cards — Belize;
  • Medcards — Bosnia and Herzegovinaа;
  • Employment records — Brazil;
  • Emergency travel documents — Canada;
  • Boating licenses — France, the Republic of Korea, the Russian Federation;
  • Veterinary ID cards — the Islamic Republic of Ira;
  • Professional ID cards — Mexico;
  • Mainland travel permit — China;
  • Firearm permit — Australia (Queensland), Philippines;
  • Hunting license — France;
  • Student ID card — Hungaryж
  • Lawyer ID card — Philippines.
193 countries of the United Nations

Australia, Austria, Azerbaijan, Albania, Algeria, Angola, Andorra, Antigua and Barbuda, Argentina, Armenia, Afghanistan, Bahamas, Bangladesh, Barbados, Bahrain, Belarus, Belize, Belgium, Benin, Bulgaria, Bolivia, Bosnia and Herzegovina, Botswana, Brazil, Brunei, Burkina Faso, Burundi, Bhutan, Vanuatu, UK, Hungary, Venezuela, East Timor, Vietnam, Gabon, Haiti, Guyana, Gambia, Ghana, Guatemala, Guinea, Guinea-Bissau, Germany, Honduras, Grenada, Greece, Georgia, Denmark, Djibouti, Dominica, Dominican Republic, Egypt, Zambia, Zimbabwe, Israel, India, Indonesia, Jordan, Iraq, Iran, Ireland, Iceland, Spain, Italy, Yemen, Cape Verde, Kazakhstan, Cambodia, Cameroon, Canada , Qatar, Kenya, Cyprus, Kyrgyzstan, Kiribati, China, Colombia, Comoros, Congo, DR Congo, North Korea, Korea, Costa Rica, Ivory Coast, Cuba, Kuwait, Laos, Latvia, Lesotho, Liberia, Lebanon, Libya, Lithuania, Liechtenstein, Luxembourg, Mauritius, Mauritania, Madagascar, Malawi, Malaysia, Mali, Maldives, Malta, Morocco, Marshall Islands, Mexico, Mozambique, Moldova, Monaco, Mongolia, Myanmar, Namibia, Nauru, Nepal, Niger, Nigeria , Netherlands, Nicaragua, New Zealand, Norway, UAE, Oman, Pakistan, Palau, Panama, Papua New Guinea, Paraguay, Peru, Poland, Portugal, Russia, Rwanda, Romania, El Salvador, Samoa, San Marino, Sao Tome and Principe, Saudi Arabia, North Macedonia, Seychelles, Senegal, Saint Vincent and the Grenadines, Saint Kitts and Nevis, Saint Lucia, Serbia, Singapore, Syria, Slovakia, Slovenia, USA, Solomon Islands, Somalia, Sudan, Suriname, Sierra Leone, Tajikistan, Thailand, Tanzania, Togo, Tonga, Trinidad and Tobago, Tuvalu, Tunisia, Turkmenistan, Turkey, Uganda, Uzbekistan, Ukraine, Uruguay, Micronesia, Fiji, Philippines, Finland, France, Croatia, Central African Republic, Chad, Montenegro, Czech Republic, Chile, Switzerland, Sweden, Sri Lanka, Ecuador, Equatorial Guinea, Eritrea, Eswatini, Estonia, Ethiopia, South Africa, South Sudan, Jamaica, Japan.

Over 40 jurisdictions and additional document issuing organizations
  • Abkhazia;
  • African Development Bank;
  • Anguilla;
  • Aruba;
  • Bermuda;
  • Bonaire, St. Eustatius and Saba;
  • Cayman islands;
  • Cook Islands;
  • Curacao;
  • Economic Community of West African States;
  • European Union;
  • Faroe islands;
  • French polynesia;
  • Gibraltar;
  • Greenland;
  • Guernsey;
  • Holy See (Vatican City State);
  • Hong Kong;
  • Interpol;
  • Isle Of Man;
  • Jersey;
  • Macau;
  • Montserrat;
  • New Caledonia;
  • Niue;
  • Territory of Northern Cyprus;
  • Organization of Eastern Caribbean States (OECS);
  • Palestine, State;
  • Saint Helena, Ascension and Tristan da Cunha;
  • Saint Martin (French part);
  • Sint Maarten (Dutch part);
  • Somaliland;
  • Taiwan Province of China;
  • African Union;
  • Republic of Kosovo;
  • Sovereign Military Order of Malta;
  • Turks and Caicos Islands;
  • Virgin Islands, British;
  • West Sahara;
  • UNHCR — United Nations High Commissioner for Refugees;
  • United Nations Interim Administration Mission in Kosov.

The full list of the supported documents is contained in a separate file.

Languages Supported by ID Engine ​

  • Cyrillic
    (Russian, Abkhazian, Belarusian, Bulgarian, Kazakh, Kyrgyz, Mongolian, Ossetian, Serbian, Tajik, Uzbek, Ukrainian).

  • Latin
    (English, Azerbaijani, Aymara, Albanian, Afrikaans, Berber, Bosnian, Hungarian, Woleai, Haitian Creole, Danish, Zulu, Indonesian, Irish, Icelandic, Spanish, Italian, Cantonese, Castilian, Catalan, Quechua, Comorian, Xhosa, Latvian , Lithuanian, Luxembourgish, Macedonian, Malay, Maltese, Mandarin, Maori, Moldovan, Nauruan, Ndau, Ndebele, German, Dutch, Norwegian, Palauan, Polish, Portuguese, Rwanda, Romanian, Rundi, Swazi, Northern Sotho, Seychellois Creole, Sesotho , Slovak, Slovenian, Somali, Swahili, Tamazight, Tetum, Tok Pisin, Tonga, Tswana, Tsonga, Turkish, Turkmen, Fiji Hindi, Fijian, Filipino, Finnish, French, Croatian, Chewa, Czech, Chibarwe, Chichewa, Shangani, Swedish, Shona, Estonian, Southern Ndebele).

  • Non-Latin Languages
    Chinese (Classical, 20,000 characters), Japanese (Hiragana, Katakana and Kanji), Korean,(Hangul), Sinhalese, Greek, Georgian, Armenian, Hebrew, Arabic, Farsi, Urdu, Tamil, Thai, Bengali.

  1. The certificate of state registration No 2020616758. Included in the Unified Register of Russian programs for electronic computers and databases (entry in the register No. 9304 dated 03/01/2021 was made on the basis of the order of the Ministry of Digital Development, Communications and Mass Communications of the Russian Federation dated 03/01/2021 No.120. Entry in the register No. 18436 dated 02/08/2023 was made on the basis of the order of the Ministry of Digital Development, Communications and Mass Communications of the Russian Federation according to the minutes of the meeting of the expert Council on 20/07/2023 No.483) https://reestr.digital.gov.ru/search/?q=2020616758. ↩︎

Copyright © 2025 SmartEngines