Azure Machine Learning Archives - https://www.theoryofcomputation.co/tag/azure-machine-learning/ Science of Computer Tue, 18 Sep 2018 16:48:36 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.3 https://i0.wp.com/www.theoryofcomputation.co/wp-content/uploads/2018/08/cropped-favicon-512x512-2.png?fit=32%2C32&ssl=1 Azure Machine Learning Archives - https://www.theoryofcomputation.co/tag/azure-machine-learning/ 32 32 149926143 Azure Machine Learning Workbench – Seems Interesting https://www.theoryofcomputation.co/azure-machine-learning-workbench/ Tue, 18 Sep 2018 16:48:36 +0000 https://www.theoryofcomputation.in/?p=203 Azure Machine Learning Workbench is a desktop application plus command-line tools, supported on both Windows and macOS. It allows you to manage machine learning solutions through the entire data science life cycle: Data ingestion and preparation Model development and experiment management Model deployment in various target environments Here are the core functionalities offered by Azure...

The post Azure Machine Learning Workbench – Seems Interesting appeared first on .

]]>
Azure Machine Learning Workbench is a desktop application plus command-line tools, supported on both Windows and macOS. It allows you to manage machine learning solutions through the entire data science life cycle:

  • Data ingestion and preparation
  • Model development and experiment management
  • Model deployment in various target environments

Here are the core functionalities offered by Azure Machine Learning Workbench:

  • Data preparation tool that can learn data transformation logic by example.
  • Data source abstraction accessible through UX and Python code.
  • Python SDK for invoking visually constructed data preparation packages.
  • Built-in Jupyter Notebook service and client UX.
  • Experiment monitoring and management through run history views.
  • Role-based access control that enables sharing and collaboration through Azure Active Directory.
  • Automatic project snapshots for each run, and explicit version control enabled by native Git integration.
  • Integration with popular Python IDEs.

For more information, reference the following articles:

Azure Machine Learning Experimentation Service

The Experimentation Service handles the execution of machine learning experiments. It also supports the Workbench by providing project management, Git integration, access control, roaming, and sharing.

Through easy configuration, you can execute your experiments across a range of compute environment options:

  • Local native
  • Local Docker container
  • Docker container on a remote VM
  • Scale out Spark cluster in Azure

The Experimentation Service constructs virtual environments to ensure that your script can be executed in isolation with reproducible results. It records run history information and presents the history to you visually. You can easily select the best model out of your experiment runs.

Real Also: What is Machine Learning?

Azure Machine Learning Model Management Service

Model Management Service allows data scientists and dev-ops teams to deploy predictive models into a wide variety of environments. Model versions and lineage are tracked from training runs to deployments. Models are stored, registered, and managed in the cloud.

Using simple CLI commands, you can containerize your model, scoring scripts and dependencies into Docker images. These images are registered in your own Docker registry hosted in Azure (Azure Container Registry). They can be reliably deployed to the following targets:

  • Local machines
  • On-premises servers
  • The cloud
  • IoT edge devices

Kubernetes running in the Azure Container Service (ACS) is used for cloud scale-out deployment. Model execution telemetry is captured in AppInsights for visual analysis.

Microsoft Machine Learning Library for Apache Spark

The MMLSpark(Microsoft Machine Learning Library for Apache Spark) is an open-source Spark package that provides deep learning and data science tools for Apache Spark. It integrates Spark Machine Learning Pipelines with the Microsoft Cognitive Toolkit and OpenCV library. It enables you to quickly create powerful, highly scalable predictive, and analytical models for large image and text datasets. Some highlights include:

  • Easily ingest images from HDFS into Spark DataFrame
  • Pre-process image data using transforms from OpenCV
  • Featurize images using pre-trained deep neural nets using the Microsoft Cognitive Toolkit
  • Use pre-trained bidirectional LSTMs from Keras for medical entity extraction
  • Train DNN-based image classification models on N-Series GPU VMs on Azure
  • Featurize free-form text data using convenient APIs on top of primitives in SparkML via a single transformer
  • Train classification and regression models easily via implicit featurization of data
  • Compute a rich set of evaluation metrics including per-instance metrics

Visual Studio Code Tools for AI

Visual Studio Code Tools for AI is an extension in Visual Studio Code to build, test, and deploy Deep Learning and AI solutions. It features many integration points with Azure Machine Learning, including:

  • A run history view displaying the performance of training runs and logged metrics.
  • A gallery view allowing users to browse and bootstrap new projects with the Microsoft Cognitive Toolkit, TensorFlow, and many other deep-learning frameworks.
  • An explorer view for selecting compute targets for your scripts to execute.

 

The post Azure Machine Learning Workbench – Seems Interesting appeared first on .

]]>
203
What is Azure Machine Learning? https://www.theoryofcomputation.co/azure-machine-learning/ Thu, 13 Sep 2018 06:50:57 +0000 https://www.theoryofcomputation.in/?p=196 Azure Machine Learning is an integrated, end-to-end data science and advanced analytics solution. It enables data scientists to prepare data, develop experiments, and deploy models at cloud scale. The main components of Azure Machine Learning are: Azure Machine Learning Workbench Azure Machine Learning Experimentation Service Azure Machine Learning Model Management Service Microsoft Machine Learning Libraries...

The post What is Azure Machine Learning? appeared first on .

]]>
Azure Machine Learning is an integrated, end-to-end data science and advanced analytics solution. It enables data scientists to prepare data, develop experiments, and deploy models at cloud scale.

The main components of Azure Machine Learning are:

  • Azure Machine Learning Workbench
  • Azure Machine Learning Experimentation Service
  • Azure Machine Learning Model Management Service
  • Microsoft Machine Learning Libraries for Apache Spark (MMLSpark Library)
  • Visual Studio Code Tools for AI

Together, these applications and services help significantly accelerate your data science project development and deployment.

Azure Machine Learning

Read Also: What is Machine Learning?

Azure Machine Learning Compatibility to Open Source

Azure Machine Learning fully supports open source technologies. Thousands of open source Python packages, such as the following machine learning frame works:

  • scikit-learn
  • TensorFlow
  • Microsoft Cognitive Toolkit
  • Spark ML

One can execute their experiments in managed environments such as Docker containers and Spark clusters.

Azure Machine Learning is built on top of the following open source technologies:

  • Jupyter Notebook
  • Apache Spark
  • Docker
  • Kubernetes
  • Python
  • Conda

It also includes Microsoft’s own open source technologies, such as Microsoft Machine Learning Library for Apache Spark and Cognitive Toolkit.

In addition, you also benefit from some of the most advanced, tried-and-true machine learning technologies developed by Microsoft designed to solve on large-scale problems. They are battle-tested in many Microsoft products, such as:

  • Windows
  • Bing
  • Xbox
  • Office
  • SQL Server

The following are some of the Microsoft machine learning technologies included with Azure Machine Learning:

  • PROSE (PROgram Synthesis using Examples)
  • microsoftml
  • revoscalepy

Azure Machine Learning Model Management

Azure Machine Learning Model Management enables you to manage and deploy machine-learning workflows and models.

Model Management provides capabilities for:

  • Model Versioning
  • Tracking models in production
  • Deploying models to production through AzureML Compute Environment with Azure Container Service and Kubernetes
  • Creating Docker containers with the models and testing them locally
  • Automated model retraining
  • Capturing model telemetry for actionable insights.

Azure Machine Learning Model Management provides a registry of model versions. It also provides automated workflows for packaging and deploying Machine Learning containers as REST APIs. The models and their runtime dependencies are packaged in Linux-based Docker container with prediction API.

Azure Machine Learning Compute Environments help to set up and manage scalable clusters for hosting the models. The compute environment is based on Azure Container Services. Azure Container Services provides automatic exposure of Machine Learning APIs as REST API endpoints with the following features:

  • Authentication
  • Load balancing
  • Automatic scale-out
  • Encryption

Azure Machine Learning Model Management provides these capabilities through the CLI, API, and the Azure portal.

Azure Machine Learning model management uses the following information:

  • Model file or a directory with the model files
  • User created Python file implementing a model scoring function
  • Conda dependency file listing runtime dependencies
  • Runtime environment choice, and
  • Schema file for API parameters

This information is used when performing the following actions:

  • Registering a model
  • Creating a manifest that is used when building a container
  • Building a Docker container image
  • Deploying a container to Azure Container Service

The following figure shows an overview of how models are registered and deployed into the cluster.

Azure Machine Learning

The post What is Azure Machine Learning? appeared first on .

]]>
196