[1]:
%run notebook_setup

If you have not already read it, you may want to start with the first tutorial: `Getting started with The Joker <1-Getting-started.ipynb>`__.

Continue generating samples with standard MCMC

When many prior samples are used with The Joker, and the sampler returns one sample, or the samples returned are within the same mode of the posterior, the posterior pdf is likely unimodal. In these cases, we can use standard MCMC methods to generate posterior samples, which will typically be much more efficient than The Joker itself. In this example, we will use pymc3 to “continue” sampling for data that are very constraining.

First, some imports we will need later:

[2]:
import astropy.coordinates as coord
import astropy.table as at
from astropy.time import Time
import astropy.units as u
import matplotlib.pyplot as plt
import numpy as np
%matplotlib inline
import corner
import pymc3 as pm
import exoplanet as xo
import arviz as az

import thejoker as tj
WARNING (theano.tensor.blas): Using NumPy C-API based implementation for BLAS functions.
[3]:
# set up a random number generator to ensure reproducibility
rnd = np.random.default_rng(seed=42)

Here we will again load some pre-generated data meant to represent well-sampled, precise radial velocity observations of a single luminous source with a single companion (we again downsample the data set here just for demonstration):

[4]:
data_tbl = at.QTable.read('data.ecsv')
sub_tbl = data_tbl[rnd.choice(len(data_tbl), size=18, replace=False)]  # downsample data
data = tj.RVData.guess_from_table(sub_tbl, t_ref=data_tbl.meta['t_ref'])
[5]:
_ = data.plot()
findfont: Font family ['serif'] not found. Falling back to DejaVu Sans.
findfont: Generic family 'serif' not found because none of the following families were found: Liberation Serif
findfont: Font family ['cursive'] not found. Falling back to DejaVu Sans.
findfont: Generic family 'cursive' not found because none of the following families were found: Liberation Serif
../_images/examples_4-Continue-sampling-mcmc_8_1.png

We will use the default prior, but feel free to play around with these values:

[6]:
prior = tj.JokerPrior.default(
    P_min=2*u.day, P_max=1e3*u.day,
    sigma_K0=30*u.km/u.s,
    sigma_v=100*u.km/u.s)

The data above look fairly constraining: it would be hard to draw many distinct orbital solutions through the RV data plotted above. In cases like this, we will often only get back 1 or a few samples from The Joker even if we use a huge number of prior samples. Since we are only going to use the samples from The Joker to initialize standard MCMC, we will only use a moderate number of prior samples:

[7]:
prior_samples = prior.sample(size=250_000,
                             random_state=rnd)
[8]:
joker = tj.TheJoker(prior, random_state=rnd)
joker_samples = joker.rejection_sample(data, prior_samples,
                                       max_posterior_samples=256)
joker_samples
[8]:
<JokerSamples [P, e, omega, M0, s, K, v0] (1 samples)>
[9]:
joker_samples.tbl
[9]:
QTable length=1
PeomegaM0sKv0
dradradkm / skm / skm / s
float64float64float64float64float64float64float64
42.532706429392620.0135627226493621761.4596816459606661.59010309130731550.07.10999685206244531.19743584329488
[10]:
_ = tj.plot_rv_curves(joker_samples, data=data)
../_images/examples_4-Continue-sampling-mcmc_15_0.png

The sample that was returned by The Joker does look like it is a reasonable fit to the RV data, but to fully explore the posterior pdf we will use standard MCMC through pymc3. Here we will use the NUTS sampler, but you could also experiment with other backends (e.g., Metropolis-Hastings, or even emcee by following this blog post):

[1]:
with prior.model:
    mcmc_init = joker.setup_mcmc(data, joker_samples)

    trace = pm.sample(tune=500, draws=500,
                      start=mcmc_init,
                      step=xo.get_dense_nuts_step(target_accept=0.95),
                      cores=1, chains=2)

AttributeErrorTraceback (most recent call last)
<ipython-input-1-1f82242a90f5> in <module>
      4     trace = pm.sample(tune=500, draws=500,
      5                       start=mcmc_init,
----> 6                       step=xo.get_dense_nuts_step(target_accept=0.95),
      7                       cores=1, chains=2)

AttributeError: module 'exoplanet' has no attribute 'get_dense_nuts_step'

If you get warnings from running the sampler above, they usually indicate that we should run the sampler for many more steps to tune the sampler and for our main run, but let’s ignore that for now. With the MCMC traces in hand, we can summarize the properties of the chains using pymc3.summary:

[ ]:
az.summary(trace, var_names=prior.par_names)

To convert the trace into a JokerSamples instance, we can use the TheJoker.trace_to_samples() method. Note here that the sign of K is arbitrary, so to compare to the true value, we also call wrap_K() to store only the absolute value of K (which also increases omega by π, to stay consistent):

[ ]:
mcmc_samples = joker.trace_to_samples(trace, data)
mcmc_samples.wrap_K()
mcmc_samples

We can now compare the samples we got from MCMC to the true orbital parameters used to generate this data:

[ ]:
import pickle
with open('true-orbit.pkl', 'rb') as f:
    truth = pickle.load(f)

# make sure the angles are wrapped the same way
if np.median(mcmc_samples['omega']) < 0:
    truth['omega'] = coord.Angle(truth['omega']).wrap_at(np.pi*u.radian)

if np.median(mcmc_samples['M0']) < 0:
    truth['M0'] = coord.Angle(truth['M0']).wrap_at(np.pi*u.radian)
[ ]:
df = mcmc_samples.tbl.to_pandas()
truths = []
colnames = []
for name in df.columns:
    if name in truth:
        colnames.append(name)
        truths.append(truth[name].value)
_ = corner.corner(df[colnames], truths=truths)

Overall, it looks like we do recover the input parameters!