CRM + Robot for automation of SEO promotion sites

SitePositions + SiteAnalyzer + PageAnalyzer = “automation of routine for SEOs”

An interesting and technically complex project designed for the leading company in the Moscow site promotion. Project development from 2011 to 2014. Currently works and actively used. Most of the requirements were born during the creation of the system and the experience of its use. A good example of the use of Agile methodology. The project is only for internal use in the company.
Framework: Symfony2

Basic «wishlist»:

• The system must run on a server in a fully automatic mode(apache+php).
• Needed an administrative interface that allows user (who has the necessary rights) to quickly and easily manage the entire system.
• The system should have a simple, intuitive interface, set of tips. Because SEOs are not always technically competent people.
• The system does not have a public section (just login form). Entrance only with login / password.
• Requires daily in automatic mode, scan the position of keywords for "goal site" with Yandex. Keep these items in the database, analyze, display…
• In automatic mode, by schedule, full download and analyze goal site . Issuing reports / graphs / problems / tips to promote the site. Everything is stored in a database in the form of "snapshots" of sites (for example: once a week download full version of site and analyze dynamics of the changes on the site). "snapshots" compare with each other, for the issue change / analyst.
• Need a "user system" .
  We can create / modify / delete user (CRUD) through the admin panel, assign him the role(role-based access control); dotted give him the right to certain pieces of system + on the dynamically generated content (ACL). Rights to dynamically generated content have a hierarchical inheritance, and shall be automatically extended to children.
• Have comments system, which allows comments almost every piece of information.
  It is necessary for communication between staff and reporting to management. When the company's active promotion 50-100 sites and 15 SEOs trying to remember them all changes that they make to the sites, the comments oh how needed. And the prince sees the work.
• It should be log the normal user transitions from search engines to "goal site".
  Collect "search requests" pages into which makes the transition. Everything is stored in a database, analyze, compare, and display in a detailed report on the sites. To trace dynamics of and effectiveness of the work on site. In general, a specific analysis of the actual effectiveness of website promotion.
• We need tools for source code analysis page .
  Seo-analysis to calculate how well placed keywords, where they are put to find an excessive amount of keywords. Print recommendation tips from our robot.
• Need a analysis of competitors , with whom we are competing for the top. You also need to monitor their positions.
• ...

Main screen:

Setting the info columns:


The ability to select the time range displayed content:


Basic concepts:


Additional indices:




Drop-down menus:

Display "A detailed analysis of the website"

The tab "Site tree": hover on all elements of the additional information is displayed.


Tab "external links" shows all external links from the site


Tab "title" shows all the meta title to the site (with the group in groups)


Tab "page size" - the size of html code for pages grouping for 25Kb

Display "detailed analysis of page"

In the process of the project was subjected to three major refactoring.

It was possible to understand the intricacies of a variety of magic seo-promotion. Really interesting project!
PS. The customer has consented to the placement of information about the system here.