Socorro Installation - Revision history

Talad at 11:46, 14 December 2013

2013-12-14T11:46:22Z

← Older revision		Revision as of 11:46, 14 December 2013
Line 485:		Line 485:
	#socorro.cron.jobs.modulelist.ModulelistCronApp\|1d		#socorro.cron.jobs.modulelist.ModulelistCronApp\|1d

	Fix umask if necessary. I have seen the umask is important to avoid problems on file access rights. Edit collector.ini and ensure		Fix umask if necessary. I have seen the umask is important to avoid problems on file access rights. I was getting files with "drwxr-sr-x" access under primaryCrashStorage/date/ , and this was preventing monitor/processor to work properly. Edit collector.ini and processor.ini and ensure

	umask='0'		umask='0'

	~~Edit processor.ini and ensure~~

	~~umask='2'~~

	'''Define your throttling conditions'''		'''Define your throttling conditions'''

2013-12-11T10:22:25Z

← Older revision		Revision as of 10:22, 11 December 2013
Line 484:		Line 484:
	#socorro.cron.jobs.automatic_emails.AutomaticEmailsCronApp\|1h		#socorro.cron.jobs.automatic_emails.AutomaticEmailsCronApp\|1h
	#socorro.cron.jobs.modulelist.ModulelistCronApp\|1d		#socorro.cron.jobs.modulelist.ModulelistCronApp\|1d

			Fix umask if necessary. I have seen the umask is important to avoid problems on file access rights. Edit collector.ini and ensure

			umask='0'

			Edit processor.ini and ensure

			umask='2'

	'''Define your throttling conditions'''		'''Define your throttling conditions'''

2013-12-10T18:32:06Z

← Older revision		Revision as of 18:32, 10 December 2013
Line 636:		Line 636:
	<span class="title">PlaneShift Crash Reports</span>		<span class="title">PlaneShift Crash Reports</span>


			'''Disable Crashmover'''

			We do not use Crashmover, so we want to disable it:

			> mv /etc/supervisor/conf.d/2-socorro-crashmover.conf /etc/supervisor/conf.d/2-socorro-crashmover.conf_deleted

	'''Cronjobs for Socorro'''		'''Cronjobs for Socorro'''

2013-12-10T16:35:49Z

← Older revision		Revision as of 16:35, 10 December 2013
Line 397:		Line 397:
	'''Install prerequisites'''		'''Install prerequisites'''

	> apt-get install supervisor rsyslog libapache2-mod-wsgi memcached		> apt-get install supervisor rsyslog libapache2-mod-wsgi memcached locales

	'''Setup directory structure'''		'''Setup directory structure'''

2013-12-10T16:23:24Z

Install all components

← Older revision		Revision as of 16:23, 10 December 2013
Line 242:		Line 242:

	timezone = 'UTC'		timezone = 'UTC'

			Ensure your database is using UTF-8 encoding or you will not be able to load special characters. Check in the conf file above where your data files are located, then:

			> export PATH=/usr/lib/postgresql/9.2/bin/:$PATH
			> initdb -D /var/lib/postgresql/9.2/main -E utf8

	> service postgresql restart		> service postgresql restart
Line 329:		Line 334:
	> export PYTHONPATH=.		> export PYTHONPATH=.
	> (execute here your command)		> (execute here your command)


	'''Populate PostgreSQL Database'''		'''Populate PostgreSQL Database'''
Line 386:		Line 392:
	> screen -S middleware python socorro/middleware/middleware_app.py --admin.conf=config/middleware.ini		> screen -S middleware python socorro/middleware/middleware_app.py --admin.conf=config/middleware.ini
	> screen -S collector python socorro/collector/collector_app.py --admin.conf=./config/collector.ini		> screen -S collector python socorro/collector/collector_app.py --admin.conf=./config/collector.ini


	== Deploy the apps for production usage ==		== Deploy the apps for production usage ==

2013-12-07T13:57:22Z

Deploy the apps for production usage

← Older revision		Revision as of 13:57, 7 December 2013
Line 620:		Line 620:

	If you have those 2 entries already, then you are fine.		If you have those 2 entries already, then you are fine.

			'''Configure the link to socorro home page'''

			If you want to change the link at the top of the home page, when you click on the logo or the "mozilla crash reports" text, you can:

			Edit /data/socorro/webapp-django/crashstats/base/templates/crashstats_base.html
			Change the href at line 18:
			<a href="/crash-stats/home/products/PlaneShift">
			Change the text at line 20:
			<span class="title">PlaneShift Crash Reports</span>

2013-12-07T12:14:46Z

Deploy the apps for production usage

← Older revision		Revision as of 12:14, 7 December 2013
Line 611:		Line 611:
	EOF		EOF


			'''Add 'Unknown' os and os_version'''

			At the time of this writing, the base dataset is not having the Unknown os name and version, and this is causing some dumps to fail. To fix this you need to add it:

			INSERT INTO os_names (os_name,os_short_name) VALUES('Unknown','unk');
			INSERT INTO os_versions (major_version,minor_version,os_name,os_version_id,os_version_string) values (0,0,'Unknown',76,'Unknown');

			If you have those 2 entries already, then you are fine.

2013-12-03T22:45:10Z

Components

← Older revision		Revision as of 22:45, 3 December 2013
Line 44:		Line 44:
	* The collector uses a filesystem to write the dumps to.		* The collector uses a filesystem to write the dumps to.
	* Running inside Apache, its log files are written in the apache logs: /var/log/apache2/error.log		* Running inside Apache, its log files are written in the apache logs: /var/log/apache2/error.log
			* main app is here: /data/socorro/application/socorro/collector/collector_app.py
			* real app is here: /data/socorro/application/socorro/collector/wsgi_breakpad_collector.py
			* storage class code is here: /data/socorro/application/socorro/external/fs/crashstorage.py

			Collector writes the dumps in the primaryCrashStore directories configured in his ini file, then also creates 2 symlinks (date->name, name->date) to be used by Monitor process.

	'''Monitor'''		'''Monitor'''

2013-11-26T16:32:08Z

Components

← Older revision		Revision as of 16:32, 26 November 2013
Line 54:		Line 54:
	* real app is here: /data/socorro/application/socorro/monitor/monitor.py		* real app is here: /data/socorro/application/socorro/monitor/monitor.py
	* is log file is here: /var/log/socorro/monitor.log		* is log file is here: /var/log/socorro/monitor.log

			Note: the monitor traverses the date branch (example: /home/socorro/primaryCrashStore/20131121/date ) of the tree looking for links from date to name (example: /home/socorro/primaryCrashStore/20131121/name ) spanning symlink. If it finds one, it knows that it has found a "new" crash. It pushes the crash_id from that symlink into the 'jobs' table. On doing that, it is supposed to delete the back link from name->date, then delete the forward link date->name.

	'''Processor'''		'''Processor'''

2013-11-23T15:29:59Z

Database Structure

← Older revision		Revision as of 15:29, 23 November 2013
Line 168:		Line 168:
	== Database Structure ==		== Database Structure ==

	I tried to generate a schema of the database... ~~work in progress..~~.		I tried to generate a schema of the database... click on it, and then click on the image again to see it full size.

	[[Image:socorro_postgres.png\|600px]]		[[Image:socorro_postgres.png\|600px]]