AI / ML - Machine learning



Serving Engines

ML Serving engines / ML Scoring engine description


ככל הנראה שהעיקר מוטיבציה זה ליצור BUNDEL אחיד בנושא


  ישנה סיריאליזציה של נתונים של ML PIPELINE

חסורון :

  תחזוקתי שלא עושה WARM UP למודול (יתכן שישפיע על הביצועים)


  התנהלות REST


speech recognition

AI ML - top 11 open source fw

seldon - seldon core - Open source platform for deploying machine learning models on Kubernetes

elephas - Deep learning on Spark with Keras databricks/spark-deep-learning

polyaxon - An open source platform for reproducible machine learning at scale.

kubeflow - The Machine Learning Toolkit for Kubernetes

pachyderm - Pachyderm lets you deploy and manage multi-stage, language-agnostic data pipelines while maintaining complete reproducibility and provenance.

chainer - A Powerful, Flexible, and Intuitive Framework for Neural Networks

pytorch - An open source deep learning platform that provides a seamless path from research prototyping to production deployment.

NVIDIA TensorRT - NVIDIA TensorRT™ is a platform for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high-throughput for deep learning inference applications. TensorRT-based applications perform up to 40x faster than CPU-only platforms during inference. With TensorRT, you can optimize neural network models trained in all major frameworks, calibrate for lower precision with high accuracy, and finally deploy to hyperscale data centers, embedded, or automotive product platforms.

caffe2 A New Lightweight, Modular, and Scalable Deep Learning Framework

kb/ai.txt · Last modified: 2023/04/03 07:01 by yehuda
Back to top
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0