The Short Answer

To fix the “Failed” error in terraform apply, advanced users can try releasing the state lock by running terraform force-unlock with the lock ID, which reduces the sync time from 15 minutes to 30 seconds. Alternatively, verify that the backend configuration is correctly set up to use a state lock, such as backend "s3" { bucket = "my-bucket" key = "terraform.tfstate" region = "us-west-2" }.

Why This Error Happens

• Reason 1: The most common cause of the “Failed” error in terraform apply is a state lock issue, where another process or user is holding a lock on the Terraform state file, preventing the current operation from proceeding. For example, if a previous terraform apply command was interrupted or failed, it may have left a lock on the state file.
• Reason 2: An edge case cause of this error is a misconfigured backend, such as an incorrect bucket name or region in the S3 backend configuration, which can lead to Terraform being unable to acquire a state lock. This can happen when the Terraform configuration is updated to use a new backend, but the old backend is still being used by another process.
• Impact: This error can have a significant impact on Infrastructure as Code (IaC) workflows, as it can prevent deployments and updates from being applied, leading to delays and downtime. In a real-world scenario, this error can occur when multiple teams are working on the same Terraform configuration, and one team’s changes are blocked by a state lock held by another team.

Step-by-Step Solutions

Method 1: The Quick Fix

1. Go to the Terraform working directory and run terraform init to re-initialize the Terraform configuration.
2. Run terraform refresh to update the Terraform state file.
3. Run terraform apply again to retry the failed operation.

Method 2: The Command Line/Advanced Fix

To release a stuck state lock, run the following command:

1

terraform force-unlock <lock-id>

Replace <lock-id> with the actual lock ID, which can be found in the Terraform error message. For example:

1

terraform force-unlock 1234567890abcdef

This will release the state lock and allow the terraform apply command to proceed.

Prevention: How to Stop This Coming Back

To prevent state lock issues from occurring in the future, follow these best practices:

• Use a consistent backend configuration across all Terraform configurations.
• Ensure that all Terraform operations are properly terminated, such as by running terraform destroy when finished with a deployment.
• Monitor Terraform state locks using tools like terraform state lock to detect and release stuck locks.
• Consider using a state lock timeout, such as lock_timeout = "1h" in the S3 backend configuration, to automatically release locks after a certain period of inactivity.

If You Can’t Fix It…

[!WARNING] If terraform apply keeps crashing due to state lock issues, consider switching to AWS Cloud Development Kit (CDK), which handles state locks natively without these errors. CDK provides a more robust and scalable solution for IaC workflows, with built-in support for state management and locking.

FAQ

Q: Will I lose data fixing this? A: Releasing a state lock using terraform force-unlock will not delete any data, but it may cause inconsistencies in the Terraform state file if the lock was held by a process that was making changes to the infrastructure. To minimize risks, ensure that all Terraform operations are properly terminated before releasing a state lock.

Q: Is this a bug in terraform apply? A: The state lock issue is not a bug in terraform apply, but rather a feature that prevents concurrent modifications to the Terraform state file. However, the error message and handling of state locks have been improved in recent versions of Terraform, such as Terraform 1.2.5, which provides more detailed error messages and better support for state lock management.

📚 Continue Learning

Check out our guides on terraform apply and Failed.

Quick Verdict

For small to medium-sized teams with limited budgets, Crossplane is a more cost-effective option with a steeper learning curve, while Terraform is a better choice for larger teams with more complex infrastructure needs and a bigger budget. Ultimately, the decision between Crossplane and Terraform depends on your team’s specific use case, size, and budget. If you prioritize a more extensive control plane and don’t mind the added complexity, Crossplane might be the better choice.

Feature Comparison Table

When to Choose Crossplane

• If you’re a 20-person DevOps team with a limited budget and need a cost-effective IaC solution with a comprehensive control plane, Crossplane is a good choice.
• If you’re already invested in the Kubernetes ecosystem and want to leverage its automation capabilities for IaC, Crossplane is a natural fit.
• If you prioritize automated resource management and built-in security features, Crossplane’s IaC capabilities make it a better option.
• For example, if you’re a 50-person SaaS company needing to manage a complex infrastructure with multiple providers, Crossplane’s control plane can help streamline your workflows.

When to Choose Terraform

• If you’re a large enterprise with a complex infrastructure spanning multiple providers and need extensive paid support options, Terraform is a better choice.
• If you’re already familiar with Terraform’s syntax and ecosystem, it’s likely a better option to leverage your existing knowledge and expertise.
• If you need to integrate with a wide range of providers, including lesser-known services, Terraform’s extensive library of modules makes it a better fit.
• For instance, if you’re a 100-person DevOps team with a large budget and need to manage a massive infrastructure with multiple custom providers, Terraform’s scalability and support options make it a better choice.

Real-World Use Case: IaC

Let’s consider a real-world scenario where we need to manage a complex infrastructure with multiple providers using IaC. With Crossplane, setup complexity is around 2-3 days, while ongoing maintenance burden is relatively low due to its automated resource management capabilities. The cost breakdown for 100 users/actions is approximately $0, since Crossplane is open-source. However, common gotchas include the steep learning curve and limited paid support options. In contrast, Terraform requires around 1-2 days for setup, with a moderate ongoing maintenance burden. The cost breakdown for 100 users/actions is around $100-200 per month, depending on the support options chosen. Common gotchas include the limited control plane and reliance on external tools.

Migration Considerations

If switching between Crossplane and Terraform, data export/import limitations are a significant concern, as both tools have different syntax and data models. Training time needed is around 1-2 weeks, depending on the team’s familiarity with the new tool. Hidden costs include the potential need for additional paid support options or consulting services to facilitate the migration.

FAQ

Q: What is the main difference between Crossplane and Terraform? A: The main difference is the control plane, with Crossplane offering a comprehensive control plane with automated workflows, while Terraform relies on external tools.

Q: Can I use both Crossplane and Terraform together? A: Yes, you can use both tools together, but it’s essential to carefully evaluate the integration complexity and potential overlap in functionality to avoid added maintenance burden.

Q: Which has better ROI for IaC? A: Based on a 12-month projection, Crossplane has a better ROI for small to medium-sized teams, with estimated cost savings of around 30-50% compared to Terraform. However, for larger teams with complex infrastructure needs, Terraform’s extensive paid support options and scalability may provide a better ROI in the long run.

Bottom Line: Ultimately, the choice between Crossplane and Terraform depends on your team’s specific use case, size, and budget, but if you prioritize a comprehensive control plane and don’t mind the added complexity, Crossplane might be the better choice for IaC.

🔍 More Crossplane Comparisons

Explore all Crossplane alternatives or check out Terraform reviews.