terraform/website/docs/modules/sources.html.markdown

297 lines
11 KiB
Markdown
Raw Normal View History

2014-09-26 23:23:38 +02:00
---
layout: "docs"
page_title: "Module Sources"
sidebar_current: "docs-modules-sources"
2016-10-01 16:21:22 +02:00
description: Explains the use of the source parameter, which tells Terraform where modules can be found.
2014-09-26 23:23:38 +02:00
---
# Module Sources
2017-08-15 08:35:33 +02:00
As documented in the [Usage section](/docs/modules/usage.html), the only required parameter when using a module is `source`.
2014-09-26 23:23:38 +02:00
2017-08-15 08:35:33 +02:00
The `source` parameter tells Terraform where the module can be found.
Terraform manages modules for you: it downloads them, organizes them on disk, checks for updates, etc. Terraform uses this `source` parameter to determine where it should retrieve and update modules from.
2014-09-26 23:23:38 +02:00
Terraform supports the following sources:
* [Local file paths](#local-file-paths)
2014-09-26 23:23:38 +02:00
* [Terraform Registry](#terraform-registry)
2017-08-15 08:35:33 +02:00
* [GitHub](#github)
2014-09-26 23:23:38 +02:00
* [Bitbucket](#bitbucket)
2014-09-26 23:23:38 +02:00
* Generic [Git](#generic-git-repository), [Mercurial](#generic-mercurial-repository) repositories
2014-09-26 23:23:38 +02:00
* [HTTP URLs](#http-urls)
2014-09-26 23:23:38 +02:00
* [S3 buckets](#s3-bucket)
2014-09-26 23:23:38 +02:00
Each is documented further below.
## Local File Paths
The easiest source is the local file path. For maximum portability, this should be a relative file path into a subdirectory. This allows you to organize your Terraform configuration into modules within one repository, for example:
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "./consul"
2014-09-26 23:23:38 +02:00
}
```
Updates for file paths are automatic: when "downloading" the module using the [get command](/docs/commands/get.html), Terraform will create a symbolic link to the original directory. Therefore, any changes are automatically available.
2014-09-26 23:23:38 +02:00
2017-08-15 08:35:33 +02:00
## Terraform Registry
The [Terraform Registry](https://registry.terraform.io) is an index of modules
written by the Terraform community.
The Terraform Registry is the easiest
way to get started with Terraform and to find modules.
The registry is integrated directly into Terraform. You can reference any
registry module with a source string of `<NAMESPACE>/<NAME>/<PROVIDER>`. Each
module's information page on the registry includes its source string.
2017-08-15 08:35:33 +02:00
```hcl
module "consul" {
source = "hashicorp/consul/aws"
version = "0.1.0"
2017-08-15 08:35:33 +02:00
}
```
The above example would use the
[Consul module for AWS](https://registry.terraform.io/modules/hashicorp/consul/aws)
from the public registry.
Registry modules support versioning. You can provide a specific version, or use
flexible [version constraints](/docs/modules/usage.html#module-versions).
2017-08-15 08:35:33 +02:00
You can learn more about the registry at the
[Terraform Registry documentation](/docs/registry/modules/use.html#using-modules).
2017-08-15 08:35:33 +02:00
## Private Registries
[Terraform Enterprise](https://www.hashicorp.com/products/terraform) provides a
[private module registry](/docs/enterprise/registry/index.html), to help
you share code within your organization. Other services can also provide
private registries by implementing [Terraform's registry API](/docs/registry/api.html).
Source strings for private registry modules are similar to public modules, but
also include a hostname. They should follow the format
`<HOSTNAME>/<NAMESPACE>/<NAME>/<PROVIDER>`.
```hcl
module "vpc" {
source = "app.terraform.io/example_corp/vpc/aws"
version = "0.9.3"
}
```
Modules from private registries support versioning, just like modules from the
public Terraform Registry.
2014-09-26 23:23:38 +02:00
## GitHub
Terraform will automatically recognize GitHub URLs and turn them into a link to the specific Git repository. The syntax is simple:
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "github.com/hashicorp/example"
2014-09-26 23:23:38 +02:00
}
```
Subdirectories within the repository can also be referenced:
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "github.com/hashicorp/example//subdir"
2014-09-26 23:23:38 +02:00
}
```
These will fetch the modules using HTTPS. If you want to use SSH instead:
```hcl
module "consul" {
source = "git@github.com:hashicorp/example.git//subdir"
}
```
**Note:** The double-slash, `//`, is important. It is what tells Terraform that that is the separator for a subdirectory, and not part of the repository itself.
2014-09-26 23:58:41 +02:00
GitHub source URLs require that Git is installed on your system and that you have access to the repository.
2014-09-26 23:23:38 +02:00
You can use the same parameters to GitHub repositories as you can generic Git repositories (such as tags or branches). See [the documentation for generic Git repositories](#parameters) for more information.
2014-09-26 23:23:38 +02:00
### Private GitHub Repos
If you need Terraform to fetch modules from private GitHub repos, you must provide Terraform with credentials to authenticate as a user with read access to those repos.
- If you run Terraform only on your local machine, you can specify the module source as an SSH URI (like `git@github.com:hashicorp/example.git`) and Terraform will use your default SSH key to authenticate.
- If you use Terraform Enterprise, consider using the private module registry. It makes handling credentials easier, and provides full versioning support. (See [Private Registries](#private-registries) above for more info.)
If you need to use modules directly from Git, you can use SSH URIs with Terraform Enterprise. You'll need to add an SSH private key to your organization and assign it to any workspace that fetches modules from private repos. [See the Terraform Enterprise docs about SSH keys for cloning modules.](/docs/enterprise/workspaces/ssh-keys.html)
- If you need to run Terraform on a remote machine like a CI worker, you either need to write an SSH key to disk and set the `GIT_SSH_COMMAND` environment variable appropriately during the worker's provisioning process, or create a [GitHub machine user](https://developer.github.com/guides/managing-deploy-keys/#machine-users) with read access to the repos in question and embed its credentials into the modules' `source` parameters:
```hcl
module "private-infra" {
source = "git::https://MACHINE-USER:MACHINE-PASS@github.com/org/privatemodules//modules/foo"
}
```
Note that Terraform does not support interpolations in the `source` parameter of a module, so you must hardcode the machine username and password if using this method.
## Bitbucket
2014-09-26 23:23:38 +02:00
Terraform will automatically recognize public Bitbucket URLs and turn them into a link to the specific Git or Mercurial repository, for example:
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "bitbucket.org/hashicorp/consul"
2014-09-26 23:23:38 +02:00
}
```
Subdirectories within the repository can also be referenced:
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "bitbucket.org/hashicorp/consul//subdir"
2014-09-26 23:23:38 +02:00
}
```
**Note:** The double-slash, `//`, is important. It is what tells Terraform that this is the separator for a subdirectory, and not part of the repository itself.
2014-09-26 23:58:41 +02:00
Bitbucket URLs will require that Git or Mercurial is installed on your system, depending on the type of repository.
2014-09-26 23:23:38 +02:00
## Private Bitbucket Repos
Private bitbucket repositories must be specified similar to the [Generic Git Repository](#generic-git-repository) section below.
```hcl
module "consul" {
source = "git::https://bitbucket.org/foocompany/module_name.git"
}
```
You can also specify branches and version withs the ?ref query
```hcl
module "consul" {
source = "git::https://bitbucket.org/foocompany/module_name.git?ref=hotfix"
}
```
You will need to run a `terraform get -update=true` if you want to pull the latest versions. This can be handy when you are rapidly iterating on a module in development.
2014-09-26 23:23:38 +02:00
## Generic Git Repository
Generic Git repositories are also supported. The value of `source` in this case should be a complete Git-compatible URL. Using generic Git repositories requires that Git is installed on your system.
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "git://hashicorp.com/consul.git"
2014-09-26 23:23:38 +02:00
}
```
You can also use protocols such as HTTP or SSH to reference a module, but you'll have specify to Terraform that it is a Git module, by prefixing the URL with `git::` like so:
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "git::https://hashicorp.com/consul.git"
2014-09-26 23:23:38 +02:00
}
module "ami" {
source = "git::ssh://git@github.com/owner/repo.git"
}
2014-09-26 23:23:38 +02:00
```
If you do not specify the type of `source` then Terraform will attempt to use the closest match, for example assuming `https://hashicorp.com/consul.git` is a HTTP URL.
2014-09-26 23:23:38 +02:00
Terraform will cache the module locally by default `terraform get` is run, so successive updates to master or a specified branch will not be factored into future plans. Run `terraform get -update=true` to get the latest version of the branch. This is handy in development, but potentially bothersome in production if you don't have control of the repository.
### Parameters
The URLs for Git repositories support the following query parameters:
2014-09-26 23:23:38 +02:00
* `ref` - The ref to checkout. This can be a branch, tag, commit, etc.
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "git::https://hashicorp.com/consul.git?ref=master"
2014-09-26 23:23:38 +02:00
}
```
## Generic Mercurial Repository
Generic Mercurial repositories are supported. The value of `source` in this case should be a complete Mercurial-compatible URL. Using generic Mercurial repositories requires that Mercurial is installed on your system. You must tell Terraform that your `source` is a Mercurial repository by prefixing it with `hg::`.
2014-09-26 23:23:38 +02:00
```hcl
2014-09-26 23:23:38 +02:00
module "consul" {
source = "hg::http://hashicorp.com/consul.hg"
2014-09-26 23:23:38 +02:00
}
```
URLs for Mercurial repositories support the following query parameters:
2014-09-26 23:23:38 +02:00
* `rev` - The rev to checkout. This can be a branch, tag, commit, etc.
```hcl
module "consul" {
source = "hg::http://hashicorp.com/consul.hg?rev=default"
}
```
2014-09-26 23:23:38 +02:00
## HTTP URLs
An HTTP or HTTPS URL can be used to redirect Terraform to get the module source from one of the other sources. For HTTP URLs, Terraform will make a `GET` request to the given URL. An additional `GET` parameter, `terraform-get=1`, will be appended, allowing
2014-09-26 23:23:38 +02:00
you to optionally render the page differently when Terraform is requesting it.
Terraform then looks for the resulting module URL in the following order:
2014-09-26 23:23:38 +02:00
1. Terraform will look to see if the header `X-Terraform-Get` is present. The header should contain the source URL of the actual module.
2. Terraform will look for a `<meta>` tag with the name of `terraform-get`, for example:
```html
<meta name="terraform-get" content="github.com/hashicorp/example" />
```
## S3 Bucket
Terraform can also store modules in an S3 bucket. To access the bucket
you must have appropriate AWS credentials in your configuration or
available via shared credentials or environment variables.
There are a variety of S3 bucket addressing schemes, most are
[documented in the S3
configuration](http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingBucket.html#access-bucket-intro).
Here are a couple of examples.
Using the `s3` protocol.
```hcl
module "consul" {
source = "s3::https://s3-eu-west-1.amazonaws.com/consulbucket/consul.zip"
}
```
Or directly using the bucket's URL.
```hcl
module "consul" {
source = "consulbucket.s3-eu-west-1.amazonaws.com/consul.zip"
}
```
## Unarchiving
Terraform will automatically unarchive files based on the extension of
the file being requested (over any protocol). It supports the following
archive formats:
* tar.gz and tgz
* tar.bz2 and tbz2
* zip
* gz
* bz2