Web Crawlers Bundle

A bundle of features for the Spiders access. Hits tracking, complete listing for info, Specific usergroup for Spiders, etc

It’s globally a merge with some small addons i wrote in the past, and as i did not want to release a ton of minimal tools that just fit together, i make a real bundle, 4 or 5 tools together, with activation and permissions settings when needed.

Settings:

nex_crawlers_bundle_options.jpg

Spiders List: a little spiders tracker for your forum. It’s not tracking each page the engine is viewing, because this is pointless. Instead, It is listing the name of the spiders that visit your sites, the last date of a visit, the number of unique visits and the number of pages viewed. That information is not very important for the indexation of your site, but it helps to see why your site may be occupied or not. You can then take action if a crawler is visiting and still giving no result on search engines.

nex_crawlers_bundle_list.jpg

You can see it in action here: vbEnhancer.com – Crawlers List

Specific Usergroup for Spiders: i released this addon on vb.org long time ago, and it was copied in source, but this version is updated and have more flexibility. You simply have to choose the proper usergroup in the settings so when a spider/crawler visit your site, it is considered having some permissions… it’s useful if you do not want to fill your robots.txt file with strange access blocks. This let you give access to crawlers for profiles but not visitors messages, etc…

Also remember to follow the TOS of the search engines you are registered to. Google until lately was blocking sites that were ghosting their content.

Display Spiders in WOL: and in any page showing « Currently Active Users » (showthread, forumdisplay, etc) … that way, you see where these beasts are visiting.. 🙂

nex_crawlers_bundle_wol_ug_markup.jpg

As you can see in this listing, the markup for the usergroup applied to the crawlers give some style to the web crawlers, easier to trace that way.

… some other tools are to be decided to join in the bundle, i’ll see later!

CRON JOB:
to make it easier on the server, there is a cronjob storing the hourly stats about the crawlers… once the cronjob is done once (it’s the cron named Hourly #1), the stats appear in the right place…:

nex_crawlers_bundle_info.jpg

…update: may 1st, 10:50, a small change, the Crawlers listing will now update the spiders list in cache if the file changed, so you can update it when needed.

…update: may 26th, a change related to a request by Calystos here, as we can apply a usergroup to the crawlers, we will now be able to add some markup to that usergroup and it will show in the WOL and online.php …

and in the Who’s Online page (demo vbEnhancer.com):

nex_crawlers_bundle_online.jpg

i made it so the « Spider » in front of each spider is deactivated in the online.php page, because it’s pointless if you ask me… but you can deactivate the plugin of the hook « online_bit_complete » if you prefer.

note: 17/06/09: update to 1.1.1, now will update the proper count and names of web crawlers in Active Users of Showthread and Forumdisplay pages… thanks to all who reported it, mainly [user]xOBKx[/user]… 🙂

note: 19/06/09: no version change, but added the spiders count in the WOL page itself… from [user]xOBKx[/user]’s suggestion.

note: 09/07/09: no version change yet, Dream updated his spiders_vbulletin.xml, so i provide it in this first post, if you want to upload it to your /includes/xml/ directory… it will update the list instantly when needed.

note: 09/07/09 by night: bundle updated with the latest spiders list from Dream, and updated some bug fixes suggested by [user]xOBKx[/user], like the extra comma when there was nobody online, and the uncached template.

MTF Prefix Driven forum

new type of forum:

Prefix Driven

instead of using sub-forums, you can now simply apply your Prefix Sets as navigation thru a forum.

On top of the FORUMDISPLAY page, instead of showing sub-forums, it will show a list of Prefix Sets, which become linkable categories. When you click a prefix, only threads related to that prefix are shown, like if you browse a specific sub-forum.

as it’s a per-forum setup, you can configure different features:

1- select which prefix is by default
2- select how much columns, for styling
3- select if using Plain or Rich text prefix styling

i’m coding this today, as i need it for a specific forum. i think it can be one of the free addons provided with MTF-core, because it is not adding anything to the functionalities of the forum, it’s just changing behavior of the usual prefix dropdown…

i’m not coding it as a MTF addon, i’m doing it pure plugins right now because i have not the time to check at the MTF… will be more available after this week, as i do not have to handle the kids anymore… for 3 months.

The Web Crawlers Bundle now released

This is the first time i make a public announcement about a Freebie, but this one worth it.

https://unpapapro.com/freebies/web-crawlers-bundle/4826/

You need to track all Web Crawlers activities?!… with this bundle, you can track them, give them permission, and have specific statistics regarding their visits. This is the most complete and the fastest package that will track your crawlers visits on vBulletin, all products merged.

MadeByMary’s products made available

Last week i made available the entire suite of products created by Mary in the last years… the part that i now own actually, as there is some other products i’m not interested to port for now, due to the lack of interest from the clients.

so here is goes: Mary’s Archive – vbEnhancer.com

This is the archive of the old work. These files are available for everybody in need of them, but they are not supported. You can download and use these versions as long as you wish, there is no restrictions, they are the full « pro » versions for each.

Updates will be made from the main forum of this section of the site.

Living Avatar is now 120$/year… vbulletin 180$… shit

ok, i know this is not related to our work, but i have to complaint about this…

Living Avatars – Download

Ziad dropped all the default features from the original version to put them in the paid version… 30$ for 3 months of download… 120$/y … it’s just an avatar engine, shit…

we need to generate something better. chck the portfolio of my designer: …: Ilustração … she is already drawing avatars and pieces, we already have a bank of hundreds of these characters with pieces, similar structure to LA, but with a wider range of packs, better quality, professional drawing, with HER as the designer we can provide professional designers packs we can sell… she is up to do it.

we need an engine… better than LA… because LA is just basical php functions, mixed and not always performant… we need something that can store the images on a different media, having a real image editor, etc…

for 120$ per year, their support is crap, they have no avatar packs for pro, no designer service and nowhere on the internet we could use others packs… we can do better.

Hambil created his Eggs avatar engine, and it was a quick job, so i suppose we can do better… 🙂

Akira Yamaoka – Room of Angel

La chanson parle d’une fille, chantant à sa mère et à la mémoire de sa mort. La mère abusait de la fille, alors elle n’a pas d’affection pour elle, mais ne peut pas s’empêcher de ressentir la douleur, d’où la ligne, « The love you never gave I give to you. / L’amour que tu ne m’as jamais donné, que je te donne. » En outre, la fille est éplorée par le fait que la seule attention qu’elle savait par la mère est l’abus reçu à un jeune âge. Alors bien sûr, elle est triste. Ainsi la ligne, « If I had died, I would have never felt sad at all. / Si j’étais morte, je ne serais jamais sentie triste du tout. » C’est plus une chanson d’émotions mixtes, et une berceuse touchante à quelqu’un qu’elle déteste, aime encore.

You lie silent there before me

Your tears may mean nothing to me now

The wind howling at the window

The Love you never gave

I give to you


Really don’t deserve it

But now there’s nothing you can do

So sleep in your only memory of me

My dearest mother


Here’s a lullaby to close your eyes (goodbye)

It was always you that I despised

I don’t feel enough for you to cry (oh well)

Here’s a lullaby to close your eyes (goodbye)

Goodbye…

Goodbye…


So insignificant

Sleeping dormant deep inside of me

Are you hiding away lost

Under the sewers

Maybe flying high in the clouds


Perhaps you’re happy without me

So many seeds have been sown in the field

And who could sprout up so blessedly

If I had died


I would have never felt sad at all

You will not hear me say I’m sorry

Where is the light

I wonder if it’s weeping somewhere


Here’s a lullaby to close your eyes (goodbye)

It was always you that I despised

I don’t feel enough for you to cry (oh well)

Here’s a lullaby to close your eyes (goodbye)

Goodbye…

Goodbye…

Custom profile picture

Hello,

I’m currently looking for a small plugin which shows the current user’s custom profile picture from the USERCP template using the file system.

I will pay 20% right after the job is confirmed, and 80% right after the job is finished. (Currently I’m thinking about 35,- USD total, paid by verified Paypal)

If you’re interested please contact me by pm at this board.

If possible including your real name, age, and reference of modifying you might have done in the past.

Don’t add me to your messenger account right away as I will simply ignore you for not respecting this tiny request.
I’m around here quite often; therefore I can assure you won’t have to wait long until my reply.

Reference of past successful paid requests:
vBulletin.org Forum
vBulletin.org Forum
vBulletin.org Forum

Reference of current open requests:
https://unpapapro.com/meet-market/custom-latest-blogs-forumhome/4810/

Best regards,

Cor

MTF First Release Changes?

Ok, today i made a lot of progress on the attachments album forum type but i still have a lot to go and i realized how big that addon actually is, compared to the other two (links and articles). So my thought is instead of the attachment albums on the first release we do Articles, Links, and Answers (because answers is not a huge addon and matches in pretty well with the other two). So how does this sound?

I’m crap at english, i need a PR person to take care of public communications…

Ok, everybody noticed that this site is filled with english errors, and that’s for a good reason: i’m not english… i’m french speaking, and i talk english like a chinese cow…

so i’d like to have the collaboration of a person i know who is good in english, like someone from the UK or Canada, so i have no language barrier.. lol

Thanks for the future help!