Cloud

Cloud (Cloud Orchestrator) is a set of modules to enable cloud management: Drupal-based Cloud Dashboard like AWS Management Console. The module supports not only public cloud like AWS but also private cloud like Kubernetes (K8s), VMware and OpenStack, and even Terraform Cloud since the system is highly modularized by Drupal architecture. The cloud management functionalities include in such as Cloud Governance and Cost-aware Features.

Vidoes

• Cloud Orchestrator - Multiple Cloud Orchestration Explained

Docs

• Cloud Contributed Module Documentation

  https://www.drupal.org/docs/8/modules/cloud

• Stanford WebCamp 2021

  https://www.slideshare.net/yasnaoi/leveraging-multiple-cloud-orchestration-and-resource-optimization

• DrupalCon CPH 2010

  http://www.slideshare.net/yasnaoi/how-to-manage-your-cloud-by-drupal-drupalcon-cph-2010

• BADCamp 2010

  http://www.slideshare.net/yasnaoi/how-to-manage-your-cloud-by-drupal

Features

AWS Dashboard

• Cloud Security

  • Integrate w/ Drupal's powerful permissions
  • Support any / own resource permissions
  • Support IAM Assume Role
  • Support IAM Switch Role

• Cloud Governance

  • Support launch templates
  • Support workflows to approve launch templates
  • Support resource tagging
  • Generate multi-region configuration automatically
  • Generate VPC for each logged-in user automatically

• Cloud Cost Optimization

  • Display Amazon EC2 resource dashboard
  • Display Amazon EC2 instance pricing listings
  • Display Instance types w/ the Amazon EC2 pricing in launch templates
  • Display instance pricing range when launching Instance(s)
  • Display long running Instances for more than 30 days
  • Display low utilization instances
  • Display detached EBS volumes
  • Display disassociated EBS snapshots
  • Display stale EBS snapshots
  • Automate / schedule instance termination
  • Notify an alert for a long running Instance by email
  • Integrate w/ AWS Instance Scheduler

Kubernetes Dashboard

• Cloud Security

  • Support deployment under airgapped network enviornment
  • Integrate w/ Drupal's powerful permissions
  • Support any / own resource permissions

• Cloud Governance

  • Support multiple K8s clusters
  • Bind Drupal's role and K8s namespace as a project
  • Support launch templates for K8s pods and deployments
  • Integrate launch templates w/ GitHub / GitLab
  • Support workflows to approve launch templates
  • Support resource annotations

• Cloud Cost Optimization

  • Display resource dashboard
  • Display namespace costs
  • Display allocated resources on K8s clusters
  • Display node heatmap for K8s clusters
  • Display node costs
  • Schedule resource allocation for Pods and Deployments
  • Limit K8s resource allocation for Pods

OpenStack Dashboard

• Cloud Security

  • Integrate w/ Drupal's powerful permissions
  • Support any / own resource permissions

• Cloud Governance

  • Support launch templates
  • Support workflows to approve quota changes

• Cloud Management

  • Support OpenStack REST APIs
  • Support OpenStack EC2 Compatible APIs
  • Manage Images
  • Manage Instances
  • Manage Key Pairs
  • Manage Networks
  • Manage Ports
  • Manage Projects
  • Manage Quotas
  • Manage Roles
  • Manage Routers
  • Manage Security Groups
  • Manage Server Groups
  • Manage Snapshots
  • Manage Stacks (Heat)
  • Manage Subnets
  • Manage Users
  • Manage Volumes

VMware Management

• Cloud Security

  • Integrate w/ Drupal's powerful permissions
  • Support any / own resource permissions

• Cloud Management

  • Manage VMs
  • Manage Hosts
  • Support any / own resource permissions

Terraform Cloud Management

• Cloud Management

  • Manage workspaces
  • Manage Runs
  • Manage States
  • Manage Variables

Install

• Cloud Orchestrator distribution (Recommended):

  • composer create-project docomoinnovations/cloud_orchestrator cloud_orchestrator:5.x-dev

• Cloud module (this module):

  • composer require drupal/cloud:5.x-dev

• Using AWS

• AWS Marketplace
• Download AWS CloudFormation template

• Download Theme

• Bootstrap Cloud theme specially designed for Cloud module

Use Case Scenarios

• From a User's Perspective, UX Includes:

  • Easy to login to the site thru SSO by using LDAP module
  • Access to multi-cloud like AWS, GCP, Azure, Kubernetes, OpenStack, VMware and Terraform Cloud
  • Control Instance lifecycle easily: Launch, Reboot, Stop and Terminate
  • Launch Instance(s) from a launch template
  • Manage cluster deployment by Terraform Cloud

• From IT Administrator's Perspective (In Addition to the User's Perspective Above), UX Includes:

  • Provide AuthN: Work with Active Directory (LDAP Server)
  • Set up AuthZ: Access permission for each functionality
  • Integrate IAM Roles
  • Manage instance images
  • Set up automatic backups and restore
  • Check cloud costs and budgets
  • Audit user activity logs

Design

• Pluggable Cloud Module Design Pattern

Roadmap

• 8.x-1.0 March 2019 (Obsolete)
  • AWS Portal
    • Get the feedback from internal users, and make it a real "practical" tool
    • IAM Role configuration
    • CloudWatch Integration
  • Security Policy Compliance and Cloud Governance
    • Image Encryption (postponed, since eventually AWS will support the feature)
    • VPC assignment w/ Flow Logs
    • EBS volume encryption by default
    • Bastion deployment support
  • Cost Optimization
    • List-up unnecessary or over-utilized resources (such as EBS volumes)
    • Alerting / Notification
• 8.x-2.0 July 2020 (Obsolete)
  • Cost Management
    • Manage budget
    • Assign "Credit" to each user
  • Multi-cloud management
    • Dashboard
    • Kubernetes
    • OpenStack
    • Terraform Cloud
• 3.0.0 June 2021 (Obsolete)
  • More multi-cloud management
    • VMware
    • Kubernetes resource optimization
    • OpenStack native API support
  • Cloud Governance
    • Workflow when a user launches an instance
• 4.0.0 February 2022 (Obsolete)
  • Edge cloud management
    • Distributed Cloud Orchestrator
    • React-based SPA preview (drupal/cloud_dashboard)
• 5.0.0 April 2023 (Obsolete)
  • Even more edge cloud management
    • Airgapped / Edge cloud management
    • Deploy Cloud Orchestrator by using Cloud Orchestrator
  • OpenStack resource management
    • OpenStack networking resources (Neutron) support
    • OpenStack quota support
    • OpenStack stack (Heat) support
    • OpenStack server group support
    • OpenStack project support
    • OpenStack role support
    • OpenStack user support
  • Other features
    • Automated testing by Behat
    • React-based SPA forms
• 6.0.0 February 2024 (Released)
  • OpenStack resource management
    • OpenStack quota approval workflow support
    • OpenStack image sharing support (Local region)
    • OpenStack image sharing support (Inter-regions)
  • Enhancements
    • Drupal 10.0, 10.1 and 10.2 support
    • React-based SPA default UI

• 7.x-dev February 2024 (Actively under development)
  • Kubernetes updates
    • maclof/kubernetes-client:0.29 support
  • Enhancements
    • Drupal Core 10.3 support

Sponsor