bag.web.pyramid.robots module

Easily serve a robots.txt file using Pyramid.

class bag.web.pyramid.robots.RobotFile[source]

Bases: object

add_rule(user_agent, disallow=[], allow=[])[source]
rules: List[Rule] = []
class bag.web.pyramid.robots.Rule(user_agent, disallow, allow)[source]

Bases: object

items: List[Tuple[str, str]] = []
bag.web.pyramid.robots.includeme(config)[source]

Integrate. The easiest, but not the only, way to use this module.

bag.web.pyramid.robots.init(config, robot)[source]