discourse/docs/install-HEROKU.md

359 lines
13 KiB
Markdown
Raw Normal View History

2013-03-10 08:51:49 -04:00
# Basic Heroku deployment
This guide takes you through the steps for deploying Discourse to the [Heroku](http://www.heroku.com/) cloud application platform. If you're unfamiliar with Heroku, [read this first](https://devcenter.heroku.com/articles/quickstart). The basic deployment of Discourse requires several services that will cost you money. In addition to the [750 free Dyno hours](https://devcenter.heroku.com/articles/usage-and-billing) provided by Heroku, the application requires one additional process to be running for the Sidekiq queue ($34 monthly), and a Redis database plan that supports a minimum of 2 databases (average $10 monthly).
For details on how to reduce the monthly cost of your application, see [Advanced Heroku deployment](#advanced-heroku-deployment).
2013-03-10 08:51:49 -04:00
2014-02-04 10:47:35 -05:00
## Clone Discourse
2013-03-10 08:51:49 -04:00
2014-02-04 10:47:35 -05:00
If you haven't already, download Discourse and create a new branch for your Heroku configuration.
2013-03-10 08:51:49 -04:00
git clone git@github.com:discourse/discourse.git
cd discourse
git checkout -b heroku
## Deploy to Heroku
2013-03-10 08:51:49 -04:00
1. Create the heroku app. This automatically creates a git remote called heroku.
heroku create your-app-name
1. Add postgres addon (command below adds the free dev version)
heroku addons:add heroku-postgresql
1. Add a suitable Redis provider from [Heroku add-ons](https://addons.heroku.com/), (this service will cost you money).
2013-03-10 08:51:49 -04:00
heroku addons:add openredis:micro
1. Configure your app to connect to redis
heroku config:get OPENREDIS_URL
heroku config:set REDIS_PROVIDER_URL=<result of above command>
heroku config:set DISCOURSE_REDIS_HOST=<host from above command>
heroku config:set DISCOURSE_REDIS_PORT=<port from above command>
heroku config:set DISCOURSE_REDIS_PASSWORD=<password from your provider>
heroku config:set DISCOURSE_REDIS_DB=<dbname from your provider>
1. Run bundler
bundle install
1. Generate a secret token in the terminal.
2013-03-10 08:51:49 -04:00
rake secret
1. Push the secret to the stored heroku environment variables, this will now be available to your app globally.
2013-03-10 08:51:49 -04:00
heroku config:add SECRET_TOKEN=<generated secret>
1. Precompile assets.
There are two options for precompilation. Either precompile locally, **before each deploy** or enable [Heroku's experimental user-env-compile](https://devcenter.heroku.com/articles/labs-user-env-compile) feature and Heroku will precompile your assets for you.
1. **Option 1:** Let Heroku compile your assets
This is the default for new apps, and seems to work fine.
2013-03-10 08:51:49 -04:00
2. **Option 2:** Precompile locally.
2013-03-10 08:51:49 -04:00
bundle exec rake assets:precompile
2013-03-10 08:51:49 -04:00
**Notice:** We don't use Foreman to start precompilation, as this would precompile in the development environment. Instead, rake assets:precompile runs in the production environment by default, as it should.
2013-03-10 08:51:49 -04:00
If Rails complains that the SECRET_TOKEN is not set, you can pass this to the environment by prefixing it to the rake method call.
2013-03-10 08:51:49 -04:00
SECRET_TOKEN=5310bc16ef6ecfd0... bundle exec rake assets:precompile
**Tip:** OSX/Linux users can set/unset environment variables in their shell.
# Set var
export SECRET_TOKEN=5310bc16ef6ecfd0...
# Unset var
unset SECRET_TOKEN
2013-03-10 08:51:49 -04:00
2013-05-21 20:09:17 -04:00
When precompiling locally make sure to alter the .gitignore file to allow the public/assets folder into version control.
2013-08-07 13:25:05 -04:00
2013-05-21 20:09:17 -04:00
*.gitignore*
```diff
- public/assets
+ # public/assets
```
Also, you'll need to add a commit to get the precompiled assets onto Heroku.
2014-03-24 10:41:37 -04:00
```bash
git add public/assets
git push heroku heroku:master
```
2013-05-21 20:09:17 -04:00
1. Tell rails to serve your compiled assets
heroku config:set DISCOURSE_SERVE_STATIC_ASSETS=true
1. Push your heroku branch to Heroku.
2013-03-10 08:51:49 -04:00
git push heroku heroku:master
1. Migrate and seed the database.
2013-03-10 08:51:49 -04:00
heroku run rake db:migrate db:seed_fu
2013-03-21 18:47:04 -04:00
You should now be able to visit your app at `http://<your-app-name>.herokuapp.com`
2013-03-10 08:51:49 -04:00
## Configure the deployed application
1. Log into the app, using your preferred auth provider.
2. Connect to the Heroku console to make the first user an Admin.
heroku run console
3. Enter the following commands.
2013-03-21 18:47:04 -04:00
```ruby
u = User.first
u.admin = true
u.approved = true
u.save
```
2013-03-10 08:51:49 -04:00
4. In Discourse admin settings, set `force_hostname` to your applications Heroku domain.
This step is required for Discourse to properly form links sent with account confirmation emails and password resets. The auto detected application url would point to an Amazon AWS instance.
2013-08-07 13:25:05 -04:00
Since you can't log in yet, you can set `force_hostname` in the console.
```ruby
SiteSetting.create(:name => 'force_hostname', :data_type =>1, :value=>'yourappnamehere.herokuapp.com')
```
2013-08-07 13:25:05 -04:00
5. Start Sidekiq.
2013-03-10 08:51:49 -04:00
2013-08-07 13:25:05 -04:00
In the [Heroku dashboard](https://dashboard.heroku.com/apps), select your app and you will see the separate processes that have been created for your application under Resources. You will only need to start the sidekiq process for your application to run properly. The worker process has been generated as a Rails default and can be ignored. As you can see **the Sidekiq process costs $34 monthly** to run. If you want to reduce this cost, check out [Advanced Heroku deployment](#advanced-heroku-deployment).
2013-03-10 08:51:49 -04:00
Click on the check-box next to the Sidekiq process and click Apply Changes
2013-03-21 18:47:04 -04:00
##### Your Discourse application should now be functional. However, you will still need to [configure mail](#email) functionality and file storage for uploaded images. For some examples of doing this within Heroku, see [Heroku add-on examples](#heroku-add-on-examples).
2013-03-10 08:51:49 -04:00
6. [Optional] Increase Garbage collection limit
When you start up your app, the admin dashboard will complain "Your server is using default ruby garbage collection parameters"
```
heroku config:add RUBY_GC_MALLOC_LIMIT=90000000
```
2013-03-10 08:51:49 -04:00
## Running the application locally
Using Foreman to start the application allows you to mimic the way the application is started on Heroku. It loads environment variables via the .env file and instantiates the application using the Procfile. In the .env sample file, we have set `RAILS_ENV='development'`, this makes the Rails environment variable available globally, and is required when starting this application using Foreman.
Create a .env file from the sample.
2013-03-10 08:51:49 -04:00
cp .env.sample .env
2013-03-10 08:51:49 -04:00
2013-03-21 18:47:04 -04:00
### Foreman commands:
2013-03-10 08:51:49 -04:00
##### Create the database
foreman run rake db:create
2013-03-10 08:51:49 -04:00
##### Migrate and seed the database
foreman run rake db:migrate db:seed_fu
2013-03-10 08:51:49 -04:00
##### Start the application using Foreman
foreman run rails server
2013-03-10 08:51:49 -04:00
##### Use Rails console, with pry
foreman run rails console
2013-08-07 13:25:05 -04:00
##### Prepare the test database
foreman run rake db:test:prepare
2013-08-07 13:25:05 -04:00
##### Run tests
foreman run rake autospec
2013-03-21 18:47:04 -04:00
# Heroku add-on examples
2013-03-21 18:47:04 -04:00
## Email
2013-03-21 18:47:04 -04:00
##### Mandrill example
1. Add the [Mandrill by MailChimp](https://devcenter.heroku.com/articles/mandrill) add-on from the [Heroku add-ons](https://addons.heroku.com/) page, or install from the command line using:
heroku addons:add mandrill:starter
2. Configure the smtp settings in the production environment config file.
*config/environments/production.rb*
```ruby
- config.action_mailer.delivery_method = :sendmail
- config.action_mailer.sendmail_settings = {arguments: '-i'}
+ config.action_mailer.delivery_method = :smtp
+ config.action_mailer.smtp_settings = {
+ :port => '587',
+ :address => 'smtp.mandrillapp.com',
+ :user_name => ENV['MANDRILL_USERNAME'],
+ :password => ENV['MANDRILL_APIKEY'],
+ :domain => 'heroku.com',
+ :authentication => :plain
+ }
```
## S3 (for file uploads)
You can't upload files to heroku, you need to use a service like S3.
Here are the [instructions for setting up S3](https://meta.discourse.org/t/setting-up-file-and-image-uploads-to-s3/7229/23)
You can run this from ```heroku run console``` to test if everything is configured correctly.
```ruby
bucket_name = Discourse.store.send :s3_bucket
bucket = Discourse.store.send :get_or_create_directory, bucket_name
f = File.open('README.md')
bucket = Discourse.store.send :upload, f, 'test.txt'
```
@adamloving: I think there is still a file size issue. I was testing with a 2MB file that wasn't big enough to trigger the "file too big" Discourse error message, but didn't make it to S3 either.
## Load Testing
##### Blitz example
1. Add the [Blitz](https://addons.heroku.com/blitz) add-on from the [Heroku add-ons](https://addons.heroku.com/) page, or install from the command line using:
heroku addons:add blitz:250
2013-07-17 10:53:33 -04:00
You can now run basic load tests against your instalation. Here's an example query with the rush of users scaling from 1 to 250 over 60 seconds. The timeout (-T) is set to 30 seconds, as after this Heroku will kill a process and return an error anyway.
-p 1-250:60 -T 30000 http://YOUR-APP-NAME.herokuapp.com/
##### loader.io example
1. Add the [loader.io](https://addons.heroku.com/loaderio) add-on from the [Heroku add-ons](https://addons.heroku.com/) page, or install from the command line using:
heroku addons:add loaderio:test
2013-08-07 13:25:05 -04:00
loader.io is still in beta, so you mileage may vary, but the tests are free for now.
They currently require you verify your domain. A simple way to do this is to add a hard coded static route to `config.routes.rb` using the loaderio verification key. You'll see the key the first time you try to run a load test.
*config/routes.rb*
```diff
Discourse::Application.routes.draw do
+ match "/loaderio-xxxxxxxxxxxxxxxxxxxx", :to => proc {|env| [200, {}, ["/loaderio-xxxxxxxxxxxxxxxxxxxx"]] }
...
end
```
# Advanced Heroku deployment
## Autoscaler
2013-08-07 13:25:05 -04:00
Adding the [Autoscaler Gem](https://github.com/JustinLove/autoscaler) can help you better manage the running cost of your application by scaling down the Sidekiq worker process when not in use. This could save up to $34 per month depending on your usage levels.
##### Whilst this Gem has the potential to save you money, it in no way guarantees it. Use of this Gem should be combined with careful monitoring of your applications processes and usage alerts where necessary.
1. Push your Heroku API key and app name to Heroku.
2013-08-07 13:25:05 -04:00
heroku config:add HEROKU_API_KEY=<get your API key from acct settings> HEROKU_APP=<your app name>
2. Add the Autoscaler Gem to the Gemfile.
*Gemfile*
2013-08-07 13:25:05 -04:00
```ruby
gem 'autoscaler', require: false
```
2013-08-07 13:25:05 -04:00
3. Modify the Sidekiq config file to use the Autoscaler middleware in production.
*config/initializers/sidekiq.rb*
2013-08-07 13:25:05 -04:00
```ruby
sidekiq_redis = { url: $redis.url, namespace: 'sidekiq' }
2013-08-07 13:25:05 -04:00
if Rails.env.production?
require 'autoscaler/sidekiq'
require 'autoscaler/heroku_scaler'
2013-08-07 13:25:05 -04:00
Sidekiq.configure_server do |config|
config.redis = sidekiq_redis
config.server_middleware do |chain|
chain.add(Autoscaler::Sidekiq::Server, Autoscaler::HerokuScaler.new('sidekiq'), 60)
end
end
2013-08-07 13:25:05 -04:00
Sidekiq.configure_client do |config|
config.redis = sidekiq_redis
config.client_middleware do |chain|
chain.add Autoscaler::Sidekiq::Client, 'default' => Autoscaler::HerokuScaler.new('sidekiq')
end
end
2013-08-07 13:25:05 -04:00
else
2013-08-07 13:25:05 -04:00
Sidekiq.configure_server { |config| config.redis = sidekiq_redis }
Sidekiq.configure_client { |config| config.redis = sidekiq_redis }
2013-08-07 13:25:05 -04:00
end
2013-08-07 13:25:05 -04:00
```
2013-08-07 13:25:05 -04:00
## S3 CDN
2013-08-07 13:25:05 -04:00
Heroku Cedar stack does not support Nginx as a caching layer, so you may want to host your static assets in a CDN so you're not hitting your rails app for every asset request.
This can be done simply using the [Asset Sync](https://github.com/rumblelabs/asset_sync) gem.
2013-07-17 10:53:33 -04:00
You'll need an Amazon S3 account set up with a bucket configured with your app name (appname-assets), and a separate user with write access to that bucket. You can create the new user in Account > Security Credentials. See [AWS best practices](http://docs.aws.amazon.com/IAM/latest/UserGuide/IAMBestPractices.html) for more details.
2013-07-17 10:53:33 -04:00
**Caveat:** This example relies on the app being deployed using the `heroku labs:enable user-env-compile` method detailed above. For instructions on manual compilation, please refer to the [Asset Sync](https://github.com/rumblelabs/asset_sync) gem readme.
1. Add the Asset Sync Gem to the Gemfile under assets.
2013-08-07 13:25:05 -04:00
*Gemfile*
```diff
group :assets do
...
+ gem 'asset_sync'
end
```
2. Update production.rb to use the asset host.
*config/environments/production.rb*
```diff
- # config.action_controller.asset_host = "http://YOUR_CDN_HERE"
+ config.action_controller.asset_host = "//#{ENV['FOG_DIRECTORY']}.s3.amazonaws.com"
```
3. Get the access keys that were created for the new user and push the S3 configs to Heroku.
heroku config:set FOG_PROVIDER=AWS AWS_ACCESS_KEY_ID=xxx AWS_SECRET_ACCESS_KEY=yyy FOG_DIRECTORY=appname-assets
2013-08-07 13:25:05 -04:00
2013-07-17 10:53:33 -04:00
4. Push the Gzip config setting to Heroku. This tells asset sync to upload Gzipped files where available.
heroku config:add ASSET_SYNC_GZIP_COMPRESSION=true
Now commit your changes to Git and push to Heroku.
2013-08-07 13:25:05 -04:00
If you open Chrome's Inspector, click on Network and refresh the page, your assets should now be showing an amazonaws.com url. Please refer to the [Asset Sync](https://github.com/rumblelabs/asset_sync) gem readme for more configuration options, or to use another CDN such as AWS CloudFront for better performance.