Warning

This documentation is for an old version of IPython. You can find docs for newer versions here.

Module: core.inputsplitter

Analysis of text input into executable blocks.

The main class in this module, InputSplitter, is designed to break input from either interactive, line-by-line environments or block-based ones, into standalone blocks that can be executed by Python as ‘single’ statements (thus triggering sys.displayhook).

A companion, IPythonInputSplitter, provides the same functionality but with full support for the extended IPython syntax (magics, system calls, etc).

For more details, see the class docstring below.

Syntax Transformations

One of the main jobs of the code in this file is to apply all syntax transformations that make up ‘the IPython language’, i.e. magics, shell escapes, etc. All transformations should be implemented as fully stateless entities, that simply take one line as their input and return a line. Internally for implementation purposes they may be a normal function or a callable object, but the only input they receive will be a single line and they should only return a line, without holding any data-dependent state between calls.

As an example, the EscapedTransformer is a class so we can more clearly group together the functionality of dispatching to individual functions based on the starting escape character, but the only method for public use is its call method.

ToDo

• Should we make push() actually raise an exception once push_accepts_more() returns False?
• Naming cleanups. The tr_* names aren’t the most elegant, though now they are at least just attributes of a class so not really very exposed.
• Think about the best way to support dynamic things: automagic, autocall, macros, etc.
• Think of a better heuristic for the application of the transforms in IPythonInputSplitter.push() than looking at the buffer ending in ‘:’. Idea: track indentation change events (indent, dedent, nothing) and apply them only if the indentation went up, but not otherwise.
• Think of the cleanest way for supporting user-specified transformations (the user prefilters we had before).

Authors

• Fernando Perez
• Brian Granger

2 Classes

class IPython.core.inputsplitter.InputSplitter

Bases: object

An object that can accumulate lines of Python source before execution.

This object is designed to be fed python source line-by-line, using

push(). It will return on each push whether the currently pushed code could be executed already. In addition, it provides a method called push_accepts_more() that can be used to query whether more input can be pushed into a single interactive block.

This is a simple example of how an interactive terminal-based client can use this tool:

isp = InputSplitter()
while isp.push_accepts_more():
    indent = ' '*isp.indent_spaces
    prompt = '>>> ' + indent
    line = indent + raw_input(prompt)
    isp.push(line)
print 'Input source was:

‘, isp.source_reset(),

__init__()

Create a new InputSplitter instance.

push(lines)

Push one or more lines of input.

This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not.

Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True.

Parameters:

lines : string

One or more lines of Python input.

Returns:

is_complete : boolean

True if the current input source (the result of the current input plus prior inputs) forms a complete Python execution block. Note that this value is also stored as a private attribute (_is_complete), so it can be queried at any time.

push_accepts_more()

Return whether a block of interactive input can accept more input.

This method is meant to be used by line-oriented frontends, who need to guess whether a block is complete or not based solely on prior and current input lines. The InputSplitter considers it has a complete interactive block and will not accept more input when either:

• A SyntaxError is raised
• The code is complete and consists of a single line or a single non-compound statement
• The code is complete and has a blank line at the end

If the current input produces a syntax error, this method immediately returns False but does not raise the syntax error exception, as typically clients will want to send invalid syntax to an execution backend which might convert the invalid syntax into valid Python via one of the dynamic IPython mechanisms.

reset()

Reset the input buffer and associated state.

source_reset()

Return the input source and perform a full reset.

class IPython.core.inputsplitter.IPythonInputSplitter(line_input_checker=True, physical_line_transforms=None, logical_line_transforms=None, python_line_transforms=None)

Bases: IPython.core.inputsplitter.InputSplitter

An input splitter that recognizes all of IPython’s special syntax.

__init__(line_input_checker=True, physical_line_transforms=None, logical_line_transforms=None, python_line_transforms=None)

push(lines)

Push one or more lines of IPython input.

This stores the given lines and returns a status code indicating whether the code forms a complete Python block or not, after processing all input lines for special IPython syntax.

Any exceptions generated in compilation are swallowed, but if an exception was produced, the method returns True.

Parameters:

lines : string

One or more lines of Python input.

Returns:

is_complete : boolean

True if the current input source (the result of the current input

plus prior inputs) forms a complete Python execution block. Note that :

this value is also stored as a private attribute (_is_complete), so it :

can be queried at any time. :

reset()

Reset the input buffer and associated state.

source_raw_reset()

Return input and raw source and perform a full reset.

transform_cell(cell)

Process and translate a cell of input.

transforms

Quick access to all transformers.

transforms_in_use

Transformers, excluding logical line transformers if we’re in a Python line.

5 Functions

IPython.core.inputsplitter.num_ini_spaces(s)

Return the number of initial spaces in a string.

Note that tabs are counted as a single space. For now, we do not support mixing of tabs and spaces in the user’s input.

Parameters:s : string Returns:n : int

IPython.core.inputsplitter.last_blank(src)

Determine if the input source ends in a blank.

A blank is either a newline or a line consisting of whitespace.

Parameters:

src : string

A single or multiline string.

IPython.core.inputsplitter.last_two_blanks(src)

Determine if the input source ends in two blanks.

A blank is either a newline or a line consisting of whitespace.

Parameters:

src : string

A single or multiline string.

IPython.core.inputsplitter.remove_comments(src)

Remove all comments from input source.

Note: comments are NOT recognized inside of strings!

Parameters:

src : string

A single or multiline input string.

Returns:

String with all Python comments removed. :

IPython.core.inputsplitter.get_input_encoding()

Return the default standard input encoding.

If sys.stdin has no encoding, ‘ascii’ is returned.