The FAQ section for jupyter magic is clearly missing something, or perhaps just has the incorrect code snippet for the example:
"In our code above, we use %load_ext to load an IPython extension by its module name, sql, and then directly use the extension by using %sql." - this is incorrect, as the code snippet does not do that.