e-learning
Running Jobs on Remote Resources with Pulsar
Abstract
Pulsar is the Galaxy Project's remote job running system. It was written by John Chilton (@jmchilton) of the Galaxy Project. It is a python server application that can accept jobs from a Galaxy server, submit them to a local resource and then send the results back to the originating Galaxy server.
About This Material
This is a Hands-on Tutorial from the GTN which is usable either for individual self-study, or as a teaching material in a classroom.
Questions this will address
- How does pulsar work?
- How can I deploy it?
Learning Objectives
- Have an understanding of what Pulsar is and how it works
- Install and configure a RabbitMQ message queueing server
- Install and configure a Pulsar server on a remote linux machine
- Be able to get Galaxy to send jobs to a remote Pulsar server
Licence: Creative Commons Attribution 4.0 International
Keywords: Galaxy Server administration, ansible, git-gat, jobs
Target audience: Galaxy Administrators
Resource type: e-learning
Version: 48
Status: Active
Prerequisites:
- A server/VM on which to deploy Pulsar
- Ansible
- Connecting Galaxy to a compute cluster
- Galaxy Installation with Ansible
- Mapping Jobs to Destinations using TPV
- Reference Data with CVMFS
Learning objectives:
- Have an understanding of what Pulsar is and how it works
- Install and configure a RabbitMQ message queueing server
- Install and configure a Pulsar server on a remote linux machine
- Be able to get Galaxy to send jobs to a remote Pulsar server
Date modified: 2024-06-14
Date published: 2019-01-28
Activity log