bag.web.pyramid.robots module

Easily serve a robots.txt file using Pyramid.

class bag.web.pyramid.robots.RobotFile

Bases: object

add_rule(user_agent, disallow=[], allow=[])

rules: List[bag.web.pyramid.robots.Rule] = []

class bag.web.pyramid.robots.Rule(user_agent, disallow, allow)

Bases: object

items: List[Tuple[str, str]] = []

bag.web.pyramid.robots.includeme(config)

Integrate. The easiest, but not the only, way to use this module.

bag.web.pyramid.robots.init(config, robot)