Looks like the recommended way (according to the tutorial) is to use RPy. I imagine there is some support for pyplot, too, given the Numpy/Scipy integration.